Release V 5.0.1

Document Release Version

Project
Release Date
Version
Lern
29 Nov 22
V 5.0.1

Details of Released Tag

Components
Jenkins Job
Deploy Tags (Devops)
Build Tags (Github Repo Tags)
Github Repository
Comments
Batch Service
Build/Core/Lms
release-5.1.0_RC1
sunbird-course-service : release-5.0.1_RC3
Batch Service
Build/Core/Cert
release-5.1.0_RC1
cert-service : release-5.0.1_RC2
Batch Service
Build/job/Lern/job/FlinkJobs
release-5.0.1_RC5
data-pipeline : release-5.0.1_RC5
Collection-cert-pre-processor, Collection-certificate-generator jobs need to be deployed
User&Org Service
Build/Core/Learner
release-5.1.0_RC1
sunbird-lms-service : **** release-5.0.1_RC2
Data Products
Build/job/Lern/job/LernDataProducts/
release-5.0.1_RC4
data-products : release-5.0.1_RC4

Summary of the Changes

  • Making SB Lern Cloud agnostic

Affected Areas:

  • Textbook upload and download
  • QRCode list download from workspace
  • Old certificate download
  • New certificate generation and download
  • Exhaust Reports - UserInfo, Progress and Reponse Exhausts
  • OrgAdmin Reports - Org Consent Report and Geo Reports

Details of the Changes

LR-262 OCI and Open stack support analysis
LR-263 CSP integration testing in Non-Ed env
LR-254 BatchService: CSP Data migration for certificate obj data in RC

Env Configurations (Needs to be done before service deployment):

The below environment variable needs to be configured in the devops repo.
Variable Name
Values
Comments
cloud_storage_base_url
https://sunbirddev.blob.core.windows.net
To store the CSP base path
cloud_storage_cname_url
https://obj.dev.sunbirded.org
To store the cname url of the CSP
Ansible Changes need to be updated in Common.yml, secrets.yml, hosts.yml
sunbird-devops-private/ansible/inventory/{{env}}/KnowledgePlatform
hosts:
## Lern dataproducts
[learning]
[raw-broker]
[report-cassandra]
[raw-coordinator]
[redis]
[raw-overlord]
[lp-cassandra]
common:
## Lern dataproducts
dp_vault_artifacts_container:
db_admin_password:
db_password:
postgres:
db_url: #"{{ groups['postgres'][0] }}"
db_username: #analytics
db_name:
db_password:
db_table_name:
db_port: 5432
db_admin_user:
db_admin_password:
data_exhaust_webhook_url:
data_exhaust_Channel:
data_exhaust_name:
user_port: 6379
secrets:
## Lern dataproducts
dp_vault_data_exhaust_token:
dp_vault_pgdb_admin_password:
dp_vault_pgdb_password:
dp_vault_druid_postgress_pass:
core_vault_sunbird_api_auth_token:
core_vault_sunbird_encryption_key: ### This variable added for admin user reports which is bein used to encrypt and decrypt data in cassandra.

Data Migrations: (Run these scripts after service deployment)

  • This script is to update the variable based relative url for cloud resources to course_batch(cassandra) and job_request(postgres) database tables.
Verification Steps after migration:
Check few records in course_batch table to see whether the certificate template cloud url is changed to variable format and also check in job_request table to see whether the report url is in relative path format.
  • Update blob URL or CNAME URL in ES ad RC DB
To change actual URL to CNAME URL or In case of opting new CSP provider, to change to new blob URL execute below scripts :
Verification Steps after migration:
Check ES course_batch index and TrainingCertificate index to see whether the certificate template cloud url is changed to new csp blob url or cname url.
Also check in postgres V_TrainingCertificate table to see whether the certificate template url is changed to new csp blob url or cname url.
  • Update system settings values for sunbird
Run the system-setting for setting the sunbird id value and the read the api
curl --location --request POST 'https://staging.sunbirded.org/api/data/v1/system/settings/set
' \
--header 'Authorization: Bearer {{authorization-key}}' \
--header 'Content-Type: application/json' \
--data-raw '{
"request" :
{
{
"id": "sunbird",
"field": "sunbird",
"value": "{\\\"latestVersion\\\":\\\"v1\\\",\\\"v1\\\":{\\\"url\\\":\\\"https:\/\/obj.stage.sunbirded.org\/portal\/terms-and-conditions-v1.html\\\"}}"
}
}
}'