Home/Case Studies/Lucidity
CASE STUDYSAAS / B2B SOFTWARE · MULTICLOUD QA AUTOMATION

Lucidity

A multi-layered QA automation system covering Lucidity's cloud audit tool and SaaS dashboard across AWS, Azure, and GCP, with Playwright UI tests and visual regression in CI.

43Weeks operated
2k+Hours of work
1Engineers

The brief

Embed a full-time QA Automation engineer to own end-to-end quality assurance for Lucidity's cloud assessment (audit) tool and SaaS dashboard, covering multi-cloud functional testing (AWS, Azure, GCP), automation framework development, and CI/CD pipeline integration — ensuring product reliability as Lucidity scales its cloud storage optimization platform toward enterprise customers.

What we built

A comprehensive, multi-layered QA automation system for Lucidity's cloud storage optimization platform. This includes:

  • A Gradle/Java E2E test framework for the desktop audit/assessment Electron app covering AWS, Azure, and GCP multi-cloud flows with column validation, delta value checks, and OS detail verification
  • A Playwright UI automation framework for the Electron assessment app and SaaS web dashboard
  • A Summary-Level Testing (SLT) framework for automated report sheet validation integrated into CI
  • Visual regression automation for the dashboard, Scaler module, website, and mobile views
  • Feature test suites for advanced infrastructure (AKS, EKS, ASR, clustered storage)
  • Cross-OS compatibility testing across Windows Server 2020/2025 and Ubuntu 20.04/2024
  • Jobs revamp, disk limit, CSV tag, and agent install search bar automation for the SaaS dashboard. All automation was PR-gated and CI-pipeline integrated via Bitbucket.
⊛ Live in production

Assessment app v2 (Electron desktop) fully tested and signed off across AWS, Azure, and GCP; Playwright UI automation suite live for dashboard features (Jobs, Disk Limit, CSV tags, Agent Install); SLT report validation framework integrated in CI pipeline; Visual regression suite active for Dashboard, Scaler, and website; Advanced feature coverage for AKS, EKS, ASR, and clustered storage in production.

How it was built, phase by phase.

8 workstreams across 43 weeks of operated delivery

  1. (001)DISCOVERWeek 1–2 (Feb 17–28, 2025)

    Audit/Assessment App Onboarding & Environment Setup

    Initial onboarding, codebase walkthrough, environment configuration across AWS, Azure, GCP, and DB setup. Establishes the foundation for all subsequent QA activity on Lucidity's cloud audit tooling.

    ✓ Full dev environment operational; QA engineer enabled to run end-to-end audits across all three cloud providers

    AWSGCPAzureBitbucketPostgreSQL/DB
  2. (002)BUILDWeek 2–14 (Feb 21 – May 9, 2025)

    E2E Automation Framework for Audit Tool (Gradle/Java)

    Design, implementation, and maintenance of an end-to-end automated test framework for Lucidity's audit/assessment tool, covering OS details verification, column validation, delta values, and multi-cloud test plans.

    ✓ Comprehensive e2e test suite covering AWS, Azure, GCP audit flows with column validation and deployment readiness checks

    GradleJavaBitbucketAWSGCPAzure
  3. (003)TESTWeek 3–21 (Feb 20 – Jun 30, 2025)

    Multi-Cloud Functional & Regression Testing (AWS, Azure, GCP)

    Extensive manual and semi-automated functional testing across AWS, Azure, and GCP cloud providers, covering full audit flows, error messages, IAM/role permissions, upload flows, CA certificates.

    ✓ All major multi-cloud flows (AWS, Azure, GCP) validated and signed off for v2 assessment app release

    AWSAzureGCPBitbucketAmplitude
  4. (004)TESTWeek 10–22 (Apr 23 – Jul 4, 2025)

    Assessment App v2 Feature Testing (New UI, Rename, Analytics)

    Testing of the v2 frontend redesign including the audit-to-assessment rename, new upload page, analytics via Amplitude, digital signature verification, multi-run command support for services/processes.

    ✓ v2 FE signed off across all three cloud providers with analytics, digital signatures, and multi-run command support validated

    AmplitudeBitbucketAzureAWSGCP
  5. (005)TESTWeek 22–26 (Jul 10 – Aug 4, 2025)

    Cross-OS & Cross-VM Compatibility Testing

    Systematic testing of the assessment application across multiple OS environments: Windows Server 2020, Windows Server 2025, Ubuntu 20.04 LTS, Ubuntu 2024, and other Linux distributions.

    ✓ Assessment app v2 validated across major Windows and Linux OS versions used in enterprise cloud environments

    Azure VMsWindows Server 2020Windows Server 2025Ubuntu 20.04Ubuntu 2024
  6. (006)BUILDWeek 27–33 (Aug 5 – Sep 26, 2025)

    Playwright UI Automation Framework

    Research, setup, and implementation of Playwright-based UI automation for the assessment (audit) Electron app, covering Azure, AWS, and GCP flows, including POC for Electron app automation.

    ✓ Playwright UI automation framework live for Azure and AWS assessment flows, GCP in progress

    PlaywrightElectronAzureAWSGCPBitbucket
  7. (007)BUILDWeek 29–34 (Aug 27 – Sep 16, 2025)

    SLT (Summary Sheet Level Testing) Automation

    Design and implementation of automated Summary Level Testing for report sheet validation — validating generated Excel/CSV reports from the assessment tool against expected output.

    ✓ SLT framework integrated into CI pipeline for full report sheet validation across all test IDs

    Python/Java (SLT framework)CI/CD pipelineBitbucketExcel/CSV
  8. (008)BUILDWeek 34–42 (Oct 14 – Nov 25, 2025)

    Dashboard & Jobs Revamp Automation (Playwright)

    Playwright-based automation of Lucidity's main SaaS dashboard features including Jobs Revamp, redirection flows, unrealized savings sort, disk limit verification, CSV tag onboarding, agent install search bar.

    ✓ Jobs revamp, disk limit, CSV tag, and agent search bar fully automated and PRs ready to merge

    PlaywrightBitbucketCI/CD pipeline

Stop renting hours. Start running functions.

Pick the function you want off your plate. We map the brain and name the outcome before you commit.