Release V 5.3.0

Hot-fix: CSP (26-06-2024)

Hot-fix: CSP (24-08-2023)

Jenkins Configurations for csp support:

Configure the variables cloud_store_group_id, cloud_store_artifact_id and cloud_store_version with proper values in the Jenkins, it can configured in the global or to the individual service of build job. For lms, user-org, flinks-jobs, lerndataproducts build jobs configure like as we mentioned below.

Configure the following values

Name - Default Value - Description

cloud_store_group_id - ${cloud_store_group_id} - Set the Cloud store sdk group id. e.g. org.sunbird cloud_store_artifact_id - ${cloud_store_artifact_id} - Set the Cloud store sdk artifact id. e.g. cloud-store-sdk

cloud_store_version - ${cloud_store_version} - Set the Cloud store sdk version. e.g 1.4.6

Config changes in Lern common.yaml for data-products

Hot-fix: 5.3.1 (05-07-2023)

Document Release Version

Hot Fix :- ML PII Data Product (23-06-2023)

Details of Released Tag

Summary of the Changes

Details of the Changes:

Default values for config

Please define below variables

Cassandra Keyspace and Table for Program:-

Flink Job Configurations for Lern:

Data Security Policy setup

Configurations to be done by System admin:

1. Setup default 'Data Security Policy' settings using tenant preference API.

Details of Released Tag

Summary of the Changes

Details of the Changes:

New APIs to onboard

Env Configurations (Needs to be done before service deployment):

Exhaust Proxy API documentation

Data Security Policy setup

Configurations to be done by System admin:

1. Setup default 'Data Security Policy' settings using tenant preference API.

1. Setup default 'PII data security settings' using tenant preference API.

Configurations that can be done by Tenants:

1. Use Tenant preference create API to create tenant specific 'Data Security Policy' settings similar to 'default' Data Security Policy settings but with tenant orgId.

1. In order to use "PUBLIC_KEY_ENCRYPTED_DATASET" security configuration for an exhaust report, tenant admin should have uploaded public pem key file using below API.

Steps to generate key pair for setting up Data Security policy configuration:

For Linux and Mac OS:

1. To generate Private Key

1. To generate Public Key

For Windows OS:

Please install GitBash: The Git installation package comes with SSH. Using Git Bash, which is the Git command line tool, you can generate SSH key pairs. Git Bash has an SSH client that enables you to connect to and interact with Triton containers on Windows.

To install Git:

2. When prompted, accept the default components by clicking Next.

3. Choose the default text editor. If you have Notepad++ installed, select Notepad++ and click Next.

4. Select to Use Git from the Windows Command Prompt and click Next.

5. Select to Use OpenSSL library and click Next.

6. Select to Checkout Windows-style, commit Unix-style line endings and click Next.

7. Select to Use MinTTY (The default terminal of mYSYS2) and click Next.

8. Accept the default extra option configuration by clicking Install. When the installation completes, you may need to restart Windows.

Launching GitBash:

1. press Start+R to launch the Run dialog.

2. Type C:\Program Files\Git\bin\bash.exe and press Enter.

Generating Key pair:

1. To generate Private Key

1. To generate Public Key

Flink Job Configurations for Lern:

Prerequired deployments for RC migration

Step to migrate old certificates to RC

Sunbird Lern BB is using Sunbird RC for generating & issuing e-credentials in its use cases (e.g.: course completion certificate) for all the latest completed courses (post March-2022). All the old certificates were custom generated and stored in Cassandra and cloud storage.

Once we migrate these certificates then we no longer need to store certificates in Cassandra and all the certificates will be using Sunbird RC going forward.

Step 1

Create Kafka topic for only the purpose of this migration process

Topic name: {{env}}.legacy.certificate.migrate

Step 2

In the spark machine, update the old-certificate-migration-job model config in mount/data/analytics/scripts/lern-model-config.sh with correct values.

Sample model config:

Note: migration job can be run single batch with "batchId": "01320961460024934435" and multiple batches with "batchId": "01320961460024934435,01220961460024934536" and for all batches with "batchId": "all" .

Step 3

Run the job with the below command in the spark machine.

Note: logs can be found in below locations,

Joblog: /mount/data/analytics/scripts/logs/joblog.log

Execution log: /mount/data/analytics/logs/lern-data-products/{current_date}-job-execution.log

Note:

Steps to Font URL migration

All the templates are having dev URLs configured for Fonts in all the environments as per our observation. All these font URLs have to be migrated to the new cname URL

Note: Before font url migration, make sure all the font files are available at cname mapped account or cloud storage container. To verify, where the font files are available, open any svg template file in editor and check the font URL's host.

Please use java 11 for running the scripts

Step 1:

Download SVG file migrator and uploader jars by below command,

Step 2:

Download the svg template files and update the font URLs in the template files.

Note: Before moving to next step, please verify atleast one svg file for whether the font URL got updated.

Step 3:

Upload the svg template files back to the cloud storage by below command.