VANDB upgrade failed, please manually upgrade the DB


Please find the article on how to fix the following issue on vsh status output on Analytics nodes, and when you run into the connection problem as highlighted.


Problem Description:

 

[versa@Analytics: \~\] $ vsh status

versa-confd is Running \[*\] process 1195

versa-lced is Running \[*\] process 1726

versa-spackmgr is Running \[-\] process 1202

versa-analytics-monitor is Running \[*\] process 1205

versa-analytics-driver is Running \[*\] process 3338

versa-analytics-app is Running \[*\] process 1758

versa-monit is Running \[*\] process 1289

versa-analytics-dataops is Running \[*\] process 1197

versa-analytics-redis is Running \[-\] process 1303

-------------------------------------------------------------

VANDB upgrade failed, please manually upgrade the DB using:

sudo /usr/bin/python3 /opt/versa/scripts/van-scripts/vandb-upgrade.py

-------------------------------------------------------------

\[versa@Analytics: \~\] $ sudo /usr/bin/python3 /opt/versa/scripts/van-scripts/vandb-upgrade.py

Starting Versa Analytics database upgrades

Checking for cluster status...

ZooKeeper JMX enabled by default

Using config: /opt/versa\_van/apps/zk/bin/../conf/zoo.cfg

Connecting...

Upgrading database schema from 5.0.3 to 5.0.4...

Database schema is up to date (5.0.4)

Keyspace van\_search does not exist

Data Configuration Migration already performed

Data Configurations updated

Data Configurations validated

- Migrating report configs...

0 processed

- Migrating completed reports...

0 processed

- Migrating schedules...

0 processed

- Migrating report configs...

0 processed

- Migrating completed reports...

0 processed

- Migrating schedules...

0 processed

Migrating ALS config if any...

Migrating Email configuration if any ...

No prior email configuration...

Migrating System Monitor configuration if any...

Connection error: ('Unable to connect to any servers', {'127.0.0.1:9042': AuthenticationFailed('Remote end requires authentication')})

Analytics Schema is different

Completed Versa Analytics database upgrades

\[versa@Analytics: \~\] $

Fix/Resolution:

Make sure, open is open and you can login to the Cassandra DB.


admin@Analytic-1:~$ nc -vz localhost 9042

admin@Analytic-1:~$ cqlsh -u cassandra -p <cassandra-password>   <<--- Cassandra password can be obtained through "vsh print-auth"


Please also make sure that, same password is present in the application.properties as vsh print-auth

admin@Analytic-1:~$ sudo cat /opt/versa/var/van-app/properties/application.properties


# Database authentication credentials

db.analytics.username=cassandra

db.analytics.password=<cassandra-password>

db.analytics.ssl.enable=false


If all is good on the above two commands, then check the following file where auth_enabled is set to true. If not then change it to 1 and re-run the sudo /usr/bin/python3 /opt/versa/scripts/van-scripts/vandb-upgrade.py,


admin@Analytic-1:~$ cat /opt/versa/scripts/van-install/cluster_config.properties

cassandra_enabled=1

solr_enabled=0

zookeeper_enabled=1


# Comma delimited hosts and port: <host1>:2181,<host2>:2181

# Required if Solr is enabled

zookeeper_hosts=172.16.25.3:2181,172.16.25.4:2181


auth_enabled=0     <<<<<<<<If it is set to 0 (false), then set it to 1 (true)


solr_host=

solr_port=8983


solr_shards=1

solr_replication_factor=1


We have raised a PR to take care of the issue, if the auth is not enabled, then read the password from application.properties.


Bug: 133845

Description: VANDB upgrade failing for AuthenticationFailed('Remote end requires authentication')})

Fix: Fix is available from Oct Hotfix 22.1.4 Image and Onwards


If you are still noticing a problem, contact support@versa-networks.com