# Flink Jobs

BatchService(LMS) with the help of flink jobs calculate consumption progress, scores and generates certificates. Also there is Merge User Courses flink job which is used to merge course and certificate data from one user account to another.

Flink Jobs in LERN have been to developed to support LMS (Learning Management System) journey of a user. Jobs are used to compute data necessary to calculate user's progress and validate the same against certificate issuance criteria and then trigger Sunbird RC to create and issue certificate to the user. 

## Data-pipeline Overview

<div data-full-width="true"><figure><img src="https://308610995-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F4ZKyfmmhMWpPkD6iYvKF%2Fuploads%2FffglV4hYdkhVtW7350dU%2FOVERVIEW%20-%20LERN%20JOBS.drawio%20(1).png?alt=media&#x26;token=88949926-bd65-479f-99c6-5c54b38b6312" alt=""><figcaption><p><strong>Data-pipeline Overview Diagram</strong></p></figcaption></figure></div>

## Certificate Generation Jobs Execution Flow

<div data-full-width="true"><figure><img src="https://308610995-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F4ZKyfmmhMWpPkD6iYvKF%2Fuploads%2FDgQfqjP2sc6TQgQG64xV%2FUntitled%20Diagram-V2%20LERN%20-%20CERTIFICATE%20GENERATION%20FLOW.drawio.png?alt=media&#x26;token=54df7c55-5ea1-4da3-879c-61ae2c18dfee" alt=""><figcaption><p><strong>Certificate Generation jobs execution flow diagram</strong></p></figcaption></figure></div>

{% embed url="<https://youtu.be/pRsRcv_hs8E?list=PLUrm4D0K_7nxlaZZYirokpx5Mo-jMd64M&t=4223>" %}
Certificate generator flink job
{% endembed %}

## Additional Reading

{% embed url="<https://project-sunbird.atlassian.net/wiki/spaces/SBDES/pages/1520042020/Course+Infra+-+Async+Jobs+-+Implementation+Design>" %}

{% embed url="<https://project-sunbird.atlassian.net/wiki/spaces/SBDES/pages/1782087720/Flink+jobs+for+certificates+generation+and+processing>" %}