Ingest Data via Backup Files

In this example, we will ingest a database inside a container via API commands and CLI command.

• Copy backup file of database into vME server:

  MySQL

  We use "nation" database for this example:

  scp /$FILEPATH/nation.sql username@x.x.x.x:/demo-pool/ingests

  MariaDB

  We use "nation" database for this example:

  scp /$FILEPATH/nation.sql username@x.x.x.x:/demo-pool/ingests

  SQL Server

  We use "BikeStores" database for this example:

  scp /$FILEPATH/BikeStores-backup.bak username@x.x.x.x:/demo-pool/ingests

  MongoDB

  We use "food" database for this example:

  scp -r /$DIRECTORYPATH/food username@x.x.x.x:/demo-pool/ingests

  PostgreSQL

  We use "dvdrental" database for this example:

  scp -r /$FILEPATH/dvdrental.tar username@x.x.x.x:/demo-pool/ingests

• Create backup script, named load-backup.sql, on /demo-pool/scripts:

  MySQL

  /* demo-pool/scripts/load-backup.sql */
  mysql -uroot -p"Default123" -e "source /mys/nation.sql"

  MariaDB

  /* demo-pool/scripts/load-backup.sql */
  mysql -uroot -p"Default123" -e "source /mys/nation.sql"

  SQL Server

  /* demo-pool/scripts/load-backup.sql */
  /opt/mssql-tools/bin/sqlcmd -S localhost -U sa -P Default123 -Q
  "USE [master];
  GO
  RESTORE DATABASE [BikeStores] 
  FROM DISK = N'/mys/BikeStores-backup.bak' WITH  FILE = 1, NOUNLOAD, STATS = 5;
  GO"

  MongoDB

  /* demo-pool/scripts/load-backup.sql */
  mongorestore -d food /mys/food

  PostgreSQL

  /* demo-pool/scripts/load-backup.sql */
  pg_restore -U postgres -d dvdrental /mys/dvdrental.tar

• Execute the script:

  • Execute by CLI commands

    MySQL

    vme data-container-script –name mygolddb01 –script load-backup.sql

    MariaDB

    vme data-container-script –name mygolddb01 –script load-backup.sql

    SQL Server

    vme data-container-script –name mygolddb01 –script load-backup.sql

    MongoDB

    vme data-container-script –name mygolddb01 –script load-backup.sql

    PostgreSQL

    vme data-container-script –name mygolddb01 –script load-backup.sql

  • Execute by API commands

    MySQL

    curl -X POST \
        -H "Content-Type: application/json" \
        -H 'username: admin' \
        -H 'api-key: xxxxx' \
        -d '{ "name": "mygolddb01", "command": "/demo-pool/scripts/load-backup.sql"}' \
        "http://x.x.x.x/docker/container/exec"

    MariaDB

    curl -X POST \
        -H "Content-Type: application/json" \
        -H 'username: admin' \
        -H 'api-key: xxxxx' \
        -d '{ "name": "mygolddb01", "command": "/demo-pool/scripts/load-backup.sql"}' \
        "http://x.x.x.x/docker/container/exec"

    SQL Server

    curl -X POST \
        -H "Content-Type: application/json" \
        -H 'username: admin' \
        -H 'api-key: xxxxx' \
        -d '{ "name": "mygolddb01", "command": "/demo-pool/scripts/load-backup.sql"}' \
        "http://x.x.x.x/docker/container/exec"

    MongoDB

    curl -X POST \
        -H "Content-Type: application/json" \
        -H 'username: admin' \
        -H 'api-key: xxxxx' \
        -d '{ "name": "mygolddb01", "command": "/demo-pool/scripts/load-backup.sql"}' \
        "http://x.x.x.x/docker/container/exec"

    PostgreSQL

    Create "dvdrental" database:

    curl -X POST \
        -H "Content-Type: application/json" \
        -H 'username: admin' \
        -H 'api-key: xxxxx' \
        -d '{ "name": "mygolddb01", "command": "psql -U postgres -c \"CREATE DATABASE dvdrental;\""}' \
        "http://x.x.x.x/docker/container/exec"

    Restore:

    curl -X POST \
        -H "Content-Type: application/json" \
        -H 'username: admin' \
        -H 'api-key: xxxxx' \
        -d '{ "name": "mygolddb01", "command": "/demo-pool/scripts/load-backup.sql"}' \
        "http://x.x.x.x/docker/container/exec"