📙
Sunbird Lern
AskDot
  • LEARN
    • Overview
    • Functional Capabilities
    • Technical Architecture
      • Technical Architecture Diagram
      • Tech Stack
    • Dependencies
    • Product Roadmap
  • USE
    • Overview
    • Release Notes
      • Release V 8.0.0 (Ongoing)
      • Release V 7.0.0
      • Release V 5.4.0
      • Release V 5.3.0
      • Release V 5.2.0
      • Release V 5.1.0
      • Release V 5.0.1
      • Release V 5.0.0
      • Release V 4.10.0
      • Release V 4.9.0
      • Release V 4.8.0
      • Release V 4.7.0
    • Developer Guide
      • USER & ORG SERVICE
        • Features/Core capabilities
        • Architecture
          • Code Flow
        • Developer Installation
          • System Requirements
          • Tech Stack
          • Installation Guide
          • Keycloak Local setup
          • Additional Installation Dependencies:
          • Source Code
          • Installation Configuration
        • Data Models
          • Cassandra
            • Data Dictionary
              • User
              • Organisation
              • System Settings
              • Role
              • Bulk Upload Process
              • Tenant Preference
              • Cassandra Migration Version
              • User Consent
              • Email Template
              • OTP
              • Page Management (LMS Service)
              • Location
              • User Notes
              • Deprecated
          • Elastic Search
          • Redis
        • APIs
          • User Management
            • User Deletion API
            • Ownership Transfer API
          • Organisation Management
          • Location Management
          • Consent Management
          • OTP Services
          • Tenant Configurations
          • Bulk Upload
          • System Settings
          • API Management Service
          • Data Sync
          • Notification APIs
        • Flink Jobs
          • User Cache Updater
          • User Deletion Cleanup Flink Job
          • Ownership Transfer Flink Job
        • Reports
          • Standard Exhaust
            • State Admin Geo report
            • State Admin Report
          • Other Jobs
            • User Cache Indexer Job
            • Delete Users Assets Report
          • Data Products Developer Installation
            • System Requirements
            • Tech Stack
            • Installation Dependencies
            • Local installation of data-products
            • Server setup Guide
            • Installation Configuration
            • Data-product creation guide
            • Troubleshooting a data-product
        • Logs, Telemetry Events
        • Configuration
          • Functional Configurations
          • System Settings
          • Email Configuration
          • SMS Configuration
          • OTP based SMS Configuration
        • Roles
          • System Roles
          • User Roles
          • RBAC
        • Dependencies
        • Keycloak on Sunbird
        • How to Guide
          • Create Organization
          • Create User
          • Add new user type & location
        • Single Sign-on with Sunbird
        • Caching and Denormalising User Metadata
          • ETLUserCacheUpdaterJob
          • UserCacheUpdaterFlinkJob
        • Unit Tests and Code Coverage
        • FAQs
      • LMS(BATCH) SERVICE
        • Features/Core Capabilities
        • Architecture
          • Code Flow
        • Developer Installation
          • System Requirements
          • Tech Stack
          • Installation Guide
          • Source Code
        • Data Models
          • Cassandra
            • Data Dictionary
          • ElasticSearch
          • Redis
        • APIs
        • Flink Jobs
          • Merge User Courses
          • Relation Cache Updater
          • Activity Aggregate Updater
          • Assessment Aggregator
          • Enrolment Reconciliation
          • Collection Certificate Pre-Processor
          • Collection Certificate Generator
        • Reports
          • On-Demand Exhaust
            • Response Exhaust
            • User Info Exhaust
            • Progress Exhaust
          • Other Jobs
            • Collection Summary Job
            • Course Batch Status Updater Job
            • Cassandra Migrator Job
            • Score Metric Migration Job
            • Assessment Score Correction Job
            • Collection Reconciliation Job
            • Course Enrollment Job
            • Course Consumption Job
        • Logs, Telemetry Events
        • Configuration
          • System Configuration
          • Functional Configuration
        • Dependencies
        • Certificate Registry and Credentialing using Sunbird-RC
          • Configuring PublicKey in Sunbird-RC
          • Server Setup guide for Sunbird-RC
          • API Guide For Sunbird-RC
        • Certificate Flow
          • Certificates Creation and Configuration
        • FAQs
      • GROUPS
        • Features/Core Capabilities
        • Architecture
          • Code Flow
        • Developer Installation
          • System Requirements
          • Tech Stack
          • Installation Guide
          • Source Code
          • Installation Configuration
        • Data Models
          • Cassandra
            • Data Dictionary
          • Redis
        • APIs
          • Create Group
        • Logs, Telemetry Events
          • UI Telemetry Events
          • Service Telemetry Events
        • Configuration
          • Functional Configurations
        • Design References
        • Dependencies
        • Unit Tests and Code Coverage
      • NOTIFICATION SERVICE
        • Features/Core Capabilities
        • Architecture
          • Code Flow
        • Developer Installation
          • System Requirements
          • Tech Stack
          • Installation Guide
          • Source Code
          • Installation Configuration
        • Data Models
          • Data Dictionary
        • APIs
        • Flink Jobs
        • Logs, Telemetry Events
        • Configuration
          • Functional Configurations
        • Dependencies
        • Unit Tests and Code Coverage
      • DISCUSSION FORUM
        • Features/Core capabilities
        • Architecture
          • Code Flow
        • Developer Installation
          • System Requirements
          • Tech Stack
          • Installation Guide
            • Nodebb setup
            • Discussion Middleware Setup
            • Discussion Middleware
            • Discussion forum integration with any application
            • Discussion-UI setup along with demo application.
            • Sunbird-lern portal for DF
          • Source Code
        • APIs
          • Category APIs
          • User APIs
          • Post APIs
          • Topic APIs
          • Forum APIs
        • Context Schema
        • Configurations
          • Nodebb Admin panel settings
          • Discussion MW & Nodebb System Config
        • Telemetry Events
        • Dependencies
      • ML SERVICE
        • DATA PIPELINE (Flink Jobs)
          • Program User Info
            • Component Diagram
            • Data Model
            • Folder Structure
          • Ml User Delete
            • Component Diagram
            • Data Model
            • Folder Structure
        • DATA PRODUCTS
          • Program Exhaust
            • Component Diagram
            • Folder Structure
    • Server Installation
    • Dependency setup
    • Deprecation
      • Release-5.4.0
    • Jenkins Jobs
    • Release Calendar
    • Learn More
      • Tech References
      • Telemetry Processing
      • Data Dictionary
        • Sample Data
      • Delete User Functionality
      • Asset Ownership Transfer
    • FAQs
  • Engage
    • Discuss
    • Contribute to Sunbird Lern
    • Raise an Issue
    • Contribution Guidelines
Powered by GitBook
On this page
  • Data Provider:
  • cassandra
  • postgres
  • and Content search API
  • Sample Job request:
  • File Structure
  • File Contents
  • Sample Data

Was this helpful?

Edit on GitHub
  1. USE
  2. Developer Guide
  3. LMS(BATCH) SERVICE
  4. Reports
  5. On-Demand Exhaust

Progress Exhaust

PreviousUser Info ExhaustNextOther Jobs

Last updated 1 year ago

Was this helpful?

Progress exhaust contains the progress-related information for the collection and the nested collections including the assessment-related scores of the collection. The nested collections and the assessments within the collection will be transposed as columns and hence the columns for each collection exhaust file would vary. The progress exhaust report is for the enrolled user and the course batch.

Data Provider:

cassandra

  1. user redis

  2. user_enrolments

  3. assessment_aggregator

  4. user_activity_agg

postgres

  1. job_request table

and Content search API

Sample Job request:

                                 tag                                  |            request_id            |      job_id      | status  |            request_data             |             requested_by             |  requested_channel   |    dt_job_submitted     |                                          download_urls                                          | dt_file_created |    dt_job_completed     | execution_time | err_message | iteration | encryption_key | batch_number |                                                                                                                      processed_batches                                                                                                                      
----------------------------------------------------------------------+----------------------------------+------------------+---------+-------------------------------------+--------------------------------------+----------------------+-------------------------+-------------------------------------------------------------------------------------------------+-----------------+-------------------------+----------------+-------------+-----------+----------------+--------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 do_2133074736487792641239_013307481768378368112:01269878797503692810 | 778A3669531143769B5E8C98D42E1CAD | progress-exhaust | SUCCESS | {"batchId":"013307481768378368112"} | fca2925f-1eee-4654-9177-fece3fd6afc9 | 01269878797503692810 | 2022-09-27 07:26:12.845 | {progress-exhaust/778A3669531143769B5E8C98D42E1CAD/013307481768378368112_progress_20220927.zip} |                 | 2022-09-27 08:02:20.728 |          29872 |             |         0 |                |              | [{"channel":"01269878797503692810","batchId":"013307481768378368112","filePath":"","fileSize":

File Structure

Format

Nomenclature

Example

CSV

progress-exhaust/{request_id}/<batch_id>_progress_<updatedDate>.csv

do_1130264512015646721166__progress__26_08_2020.csv

File Contents

Column Label

Column Type

Data Type

Description

Collection Id

Static

String

Id of the collection.

Collection Name

Static

String

Collection Title

Batch Id

Static

String

Batch Id

Batch Name

Static

String

Batch Title

User UUID

Static

String

The system generated unique user ID

User Name

Static

String

Name of the user

State

Static

String

User declared state for self signed up users. If the user is a org validated user then the state as passed from org SSO or derived from Sub-Org ID.

District

Static

String

User declared district for self signed up users. If the user is a org validated user then the district as passed from Org SSO or derived from Sub-Org ID.

Enrolment Date

Static

Date

Collection enrolment date (for nested courses/collections it will be the parent collection enrolment date)

Completion Date

Static

Date

Collection completion date (for nested courses/collections it will be the parent collection completion date)

Progress

Static

Number

Collection progress (for nested courses/collections this will be the parent collection progress)

Certificate Status

Static

String

Issued - if the certificate is issued. Blank - if it is not issued and. Failed - if issue has failed

Total Score

Static

Number

Total Score received by the user across all assessments within the collection with category type as “SelfAssess”

Sample Data

Collection Id,Collection Name,Batch Id,Batch Name,User UUID,User Name,State,District,Enrolment Date,Completion Date,Progress,Certificate Status,Total Score
do_1130934466492252161819,Test Course,1.3093449510953E+017,Batch1,f703de4e-d47a-4adb-856c-de122e6a0b32,Mathew Pallan,Kerala,Thrissur,2020-08-25 13:45:54:150+0000,2020-08-27 13:45:54:150+0000,100,Issued,7
do_1130934466492252161819,Test Course,1.3093449510953E+017,Batch1,587204af-41db-4313-b3ab-cf022d3055c6,Krishna Jampana,Andhra Pradesh,Vizag,2020-08-25 02:15:58:691+0000,,57,,6