CICD - Optimizing hard drive space on Controller and Test Nodes

Reduce required hard drive size on Test Nodes

Make sure you are using latest version available of AIQ. Previous of AIQ have known issues where temporary files were not always deleted in some circumstances.

Do not install MySQL on a Test Nodes.

Do not configure any repository on a Test Node.

Setup your root folders that are used when running Bulk Scenarios so they contain only the required files.

Avoid storing anything that is not required to run a scenario in your repositories. This includes things like reports, images, historical data, etc. In particular, store any generated AISG executions (formerly known as Blueprints) in an AWS S3 type repository, which is more suited for big files than GIT repositories.

Consider organizing your assets in multiple root folders. For example if you have two different web apps , divide the test assets into two root folders, one for every web app. This might involve duplicating shared test assets.

Reduced required hard drive size on the Controller

Make sure you are using latest version available of AIQ. Previous of AIQ have known issues where temporary files were not always deleted in some circumstances.

Do not install MySQL in the controller. A separate server should host the MySQL server.

Avoid storing anything that is not required to run a scenario in your repositories. This includes things like reports, images, historical data, etc. In particular, store any generated AISG executions (formerly known as Blueprints) in an AWS S3 type repository, which is more suited for big files than GIT repositories.

Consider organizing your assets in multiple root folders. For example if you have two different web apps, divide the test assets into two root folders, one for every web app. This might involve duplicating shared test assets.

Make sure that your AIQ users only have the required repositories in their accounts.

If your GIT repository size is too large, this might be because there are a lot of past commits stored in the GIT database to preserve history. This history can be removed by creating a new repository and copying the current files in your repository and then using this new repository in your AIQ repository configurations. Doing this can have a huge impact in reducing the space needed for storing the local copies of your repository on the Controller.

When running CICD pipelines there is a mode where the pipeline will assume that the required test assets for the scenario are already present in a Controller configured repository. This prevents the CICD agent cloning the repository and then copying the root folder from the CICD agent to the Controller before starting the scenario. That process takes time and uses hard disk space on the Controller.

To enable this mode you need to provide the full path, including the repository name of the scenario, in the ${scenario} variable in the build.xml file.

For example, assuming the AIQ user specified in the controller.json is cicduser@example.com, you must login with that user and configure the repository and annotate the name of the repository you specified when configuring it. If you named it as ‘MyRepo’ then assign the following value to your scenario parameter:

scenario=REPOSITORY/MyRepo/<path_to_scenario>/<scenario_file_name>