Developing a MVP (Minimum Viable Product) infrastructure that would integrate with the Proof-of-Concept (PoC) web application.

Project Summary:

Our client wanted to implement the following application and services to better serve their customers, who are data teams and organizations that build with or on data infrastructure.

Our client wants us to put together a base infrastructure of tooling;

• Apache Superset

• dbt

• OpenMetadata

• ZenML

• Apache Iceberg

Along with shared services to support the above;

• Apache Airflow

• Postgres

• AWS Services

That will support their customer journeys. The First Journey was to build the “Data Science Journey”. It was necessary to know which proposed “Modern Data Infrastructure” could be integrated and deployed in a MVP capacity. The goal was to build an MVP (Minimum Viable Product) infrastructure that would integrate with the Proof-of-Concept (PoC) web application, which was previously working with a subset of these components.

Solution:

For fulfilling the requirements of client, Legit Bytes team proposed a solution for deploying the entire infrastructure on AWS using AWS Managed Kubernetes Service (EKS) and integrating the components with each other. Team also proposed the use of additional AWS services, such as S3 and RDS, to support the deployment and ensure scalability. Additionally, the Legit Bytes team proposed a backend solution for authentication and other related tasks to the client, with the aim to optimize the infrastructure and reducing AWS pricing as much as possible.

Results:

The MVP infrastructure for the Data Science Journey was successfully deployed on AWS, meeting the needs of client’s customers. The infrastructure was also integrated with the PoC web app, accelerating development and reducing time-to-market. The Legit Bytes team’s AWS service experts ensured the infrastructure was scalable, reliable, and cost-effective.

Client Feedback:

NP & Cyberoi are great to work with and we’re looking forward to working with them more. Overall, the Legit Bytes team’s proposal for the Modern Data Infrastructure MVP is an excellent example of how companies can use a structured approach to prioritize customer needs and build a successful infrastructure.