Data Engineer

<p><b><u>Key responsibilities on this engagement</u></b></p> <p> Run the Sprint 1 architecture review of the existing UAT codebase (S3 + Glue + S3 Tables + OpenSearch + Athena) and deliver written gap findings.</p> <p> Design the metadata schema, taxonomy, and field catalogue (Light, Brain, Power).</p> <p> Tune data orchestration - Glue jobs, Athena queries, S3 Tables config, scheduling. Lead the deep-dive technical sessions with analysts on visualization requirements </p> <p> Build and validate the simulation data onboarding pipeline against real data - including the 30 GB-per-run acoustic spectra dataset.</p> <p> Configure and validate the OpenSearch k-NN vector store and the Bedrock embedding pipeline.</p> <p> Author the AI/ML data export format specification and the AI onboarding pattern document.</p> <p> Co-design the API middleware blueprint with...