Release V 5.3.0
Last updated
Last updated
Component | Build Job | Build Tag | Deploy Job | Deployment | Comment |
---|
Component | Build Job | Build Tag | Deploy Job | Deployment | Comment |
---|
Jenkins Configurations for csp support:
Configure the variables cloud_store_group_id, cloud_store_artifact_id and cloud_store_version with proper values in the Jenkins, it can configured in the global or to the individual service of build job. For lms, user-org, flinks-jobs, lerndataproducts build jobs configure like as we mentioned below.
Name - Default Value - Description
cloud_store_group_id - ${cloud_store_group_id} - Set the Cloud store sdk group id. e.g. org.sunbird cloud_store_artifact_id - ${cloud_store_artifact_id} - Set the Cloud store sdk artifact id. e.g. cloud-store-sdk
cloud_store_version - ${cloud_store_version} - Set the Cloud store sdk version. e.g 1.4.6
Summary of the Changes
Details of the Changes:
Please define below variables
Configurations to be done by System admin:
Setup default 'Data Security Policy' settings using tenant preference API.
Details of the Changes:
Configurations to be done by System admin:
Please upload the tool to your public cloud location or to your repository and provide the link to the same in below system setting variable value.
Setup default 'Data Security Policy' settings using tenant preference API.
Setup default 'PII data security settings' using tenant preference API.
Configurations that can be done by Tenants:
Use Tenant preference create API to create tenant specific 'Data Security Policy' settings similar to 'default' Data Security Policy settings but with tenant orgId.
In order to use "PUBLIC_KEY_ENCRYPTED_DATASET" security configuration for an exhaust report, tenant admin should have uploaded public pem key file using below API.
To generate Private Key
To generate Public Key
Please install GitBash: The Git installation package comes with SSH. Using Git Bash, which is the Git command line tool, you can generate SSH key pairs. Git Bash has an SSH client that enables you to connect to and interact with Triton containers on Windows.
To install Git:
When prompted, accept the default components by clicking Next.
Choose the default text editor. If you have Notepad++ installed, select Notepad++ and click Next.
Select to Use Git from the Windows Command Prompt and click Next.
Select to Use OpenSSL library and click Next.
Select to Checkout Windows-style, commit Unix-style line endings and click Next.
Select to Use MinTTY (The default terminal of mYSYS2) and click Next.
Accept the default extra option configuration by clicking Install. When the installation completes, you may need to restart Windows.
Launching GitBash:
press Start+R to launch the Run dialog.
Type C:\Program Files\Git\bin\bash.exe and press Enter.
Generating Key pair:
To generate Private Key
To generate Public Key
Sunbird Lern BB is using Sunbird RC for generating & issuing e-credentials in its use cases (e.g.: course completion certificate) for all the latest completed courses (post March-2022). All the old certificates were custom generated and stored in Cassandra and cloud storage.
Once we migrate these certificates then we no longer need to store certificates in Cassandra and all the certificates will be using Sunbird RC going forward.
Step 1
Create Kafka topic for only the purpose of this migration process
Topic name: {{env}}.legacy.certificate.migrate
Step 2
In the spark machine, update the old-certificate-migration-job
model config in mount/data/analytics/scripts/lern-model-config.sh
with correct values.
Sample model config:
Note: migration job can be run single batch with "batchId": "01320961460024934435"
and multiple batches with "batchId": "01320961460024934435,01220961460024934536"
and for all batches with "batchId": "all"
.
Step 3
Run the job with the below command in the spark machine.
Note: logs can be found in below locations,
Joblog: /mount/data/analytics/scripts/logs/joblog.log
Execution log: /mount/data/analytics/logs/lern-data-products/{current_date}-job-execution.log
Note:
All the templates are having dev URLs configured for Fonts in all the environments as per our observation. All these font URLs have to be migrated to the new cname URL
Note: Before font url migration, make sure all the font files are available at cname mapped account or cloud storage container. To verify, where the font files are available, open any svg template file in editor and check the font URL's host.
Please use java 11 for running the scripts
Download SVG file migrator and uploader jars by below command,
Download the svg template files and update the font URLs in the template files.
Note: Before moving to next step, please verify atleast one svg file for whether the font URL got updated.
Upload the svg template files back to the cloud storage by below command.
Component | Build Job | Build Tag | Deploy Job | Deployment | Comment |
---|
Project | Release Date | Version |
---|
Components | Build Jenkins Job | Build Tag | Deploy Jenkins Job | Deploy Tag | Comment |
---|
User detail (PII) report for ML programs - Data Product User detail (PII) report for ML programs - Flink Job
default config for
Name of the Flink Job added |
---|
Components | Build Jenkins Job | Build Tag | Deploy Jenkins Job | Deploy Tag | Comment |
---|
OldCertificateMigration spark data-product LegacyCertificateMigrator Flink job Sunbird RC changes for updating schema for issued date Certificate template font url migration , PII data security Local setup of Data-pipeline - Ubuntu & Mac - Github and Microsite update Local setup of UserOrg - Ubuntu & Mac - Github and Microsite update Local setup of LMS - Ubuntu & Mac - Github and Microsite update Point the channel create API to content-service instead of learning-service Textbook APIs code cleanup from Course-Batch service Microsite update with Certificate generation flow diagram Group service - activity type should be case insensitive Local setup of LMS - Ubuntu & Mac - Mock service setup Local setup of Sunbird-utils - Ubuntu & Mac - Github and Microsite update
The below environment variable needs to be configured in the 'sunbird-lms-service.env' file dev ops repo. Ref:
Variable Name | Values | Comments |
---|
Execute CURL for providing link to download "Decryption Tool". Tool reference:
Download and initiate the .
Name of the Flink Job added |
---|
Reference Link:
Note: After migrating old certificates to RC, certificate verification of old certificates will become invalid. To support to old certificate verification, Sunbird ED
building block is implementating in portal service in release 6.0. Kindly find the ticket in . So recommended to migrate the certificates after getting the old certification verification support as well.
Verification steps can be found in the design page:
Configuration for making content read URL dynamic: Please define the below URL in the sunbird_lms-service.env file this will make the content read endpoint URL Configurable.