Activity Aggregate Updater
Last updated
Last updated
'activity-aggregate-updater' job updates the Course progress of the enrolled users and upon completion of the course, pushes an event to certificate pre-processor job to validate and issue certificate.
kafka.input.topic
{{env}}.coursebatch.job.request
Kafka topic from which messages/events are read to be processed.
kafka.output.failed.topic
{{env}}.activity.agg.failed
Kafka topic to which message is written when an exception occurs while processing an event.
kafka.audit.topic
{{env}}.telemetry.raw
Kakfa topic to which and audit message is written to.
kafka.certissue.topic
{{env}}.issue.certificate.request
Kafka topic used to trigger certificate issue pre-processor job
kafka.groupId
{{env}}-activity-aggregate-updater-group
Kafka input topic group Id
lms-cassandra.keyspace
sunbird_courses
Cassandra keyspace name
lms-cassandra.content_consumption.table
user_content_consumption
Cassandra table used to store content wise data for a collection of a batch by a user. Content progress, status etc
lms-cassandra.user_enrolments.table
user_enrolments
Cassandra table used to store user enrolment data in a collection of a particular batch. This also holds the consumption progress, enrolment status and issued certificate details
lms-cassandra.user_activity_agg.table
user_activity_agg
Cassandra table used to store user consumption aggregate details of a collection in a batch. Aggregates like the consumption completed content count
redis.database.relationCache.id
10
Redis index from which computed data like leafnodes and optionalnodes is read.
dedup-redis.host
IP of deduplicate Redis host
De-duplication Redis is used to remove duplicate events possibly part of the events list in kafka input topic which is fetched in batch size of 'threshold.batch.read.size' parameter mentioned below.
dedup-redis.port
port
port of deduplicate Redis
dedup-redis.database.index
13
De-duplication Redis index
dedup-redis.database.expiry
604800
De-duplication Redis Expiry time
threshold.batch.read.interval
NOT USED
threshold.batch.read.size
1000
Flink stream window size
threshold.batch.write.size
10
Property used to specify batch size of the database update queries while updating a specific cassandra table in batch format
activity.module.aggs.enabled
true
Used to configure if the consumption aggregation calculation is to be enabled on course leaf nodes
activity.input.dedup.enabled
true
Used to configure if the aggregation job is to run in De-duplication mode
activity.filter.processed.enrolments
true
Used to configure if the activity aggregation process is to be skipped for user enrolments with status 2 (completed courses)
activity.collection.status.cache.expiry
3600 (in seconds)
Expiry time of TTL cache set to read or store latest collection 'status' information. If latest TTL cache doesnt have collection 'status' information, then the same is read from Search service configured below and TTL cache will be updated.
service.search.basePath
IP of the search service
IP of the search service
Sample event:
