Job Summary:
We are looking for a talented AWS Data & Gen AI Engineer to join our team, responsible for designing and implementing data-driven solutions using AWS services and integrating advanced Generative AI capabilities. The ideal candidate will have expertise in AWS cloud infrastructure, data engineering, and AI/ML models, with a focus on developing scalable data pipelines and AI-driven solutions that enhance business outcomes.
Responsibilities
- Design and build scalable data pipelines using AWS services such as Glue, Redshift, S3, and EMR to process and transform large datasets.
- Implement best practices for data storage, data lakes, and data warehousing on AWS to ensure optimal performance, security, and cost-efficiency.
- Develop and integrate Generative AI models using AWS SageMaker, Bedrock, and other AI/ML services to deliver intelligent automation and insights.
- Build, train, and fine-tune machine learning models, including Generative AI models, for various business use cases.
- Implement data governance frameworks to ensure data integrity, quality, and compliance with industry regulations.
- Secure data environments by enforcing best practices for AWS Identity and Access Management (IAM), encryption, and data privacy policies.
- Automate data processing and machine learning workflows using AWS Lambda, Step Functions, and Infrastructure-as-Code (IaC) tools like CloudFormation or Terraform.
- Continuously optimize data architectures and AI solutions to reduce costs and improve performance.
- Collaborate with cross-functional teams to identify business challenges and design data-driven AI solutions that address them.
- Provide technical guidance to teams on AWS data services and AI/ML best practices.
- Monitor and maintain the performance of data pipelines, AI models, and AWS infrastructure, ensuring they are robust, reliable, and scalable.
- Troubleshoot data and AI model issues, providing timely resolutions to maintain uninterrupted operations.
Skills Requirement
- Bachelor's degree in Computer Science, Data Science, Engineering, or related fields.
- 3-5 years of hands-on experience in AWS data engineering and AI/ML projects.
- Proven experience with AWS services such as Glue, Redshift, S3, SageMaker, and Lambda.
- Experience with AI/ML model development, especially in Generative AI models and their practical applications.
- Strong knowledge of AWS data services (Redshift, Glue, Athena, Kinesis, etc.) and AI/ML services (SageMaker, Bedrock, etc.).
- Proficiency in programming languages like Python, SQL, or R for data processing and AI model development.
- Experience with data analytics, ETL processes, and machine learning model training and deployment.
- Strong problem-solving and analytical skills.
- Excellent communication skills with the ability to translate complex technical concepts into business-friendly language.
- Ability to work in a collaborative, fast-paced environment and adapt to changing business needs.
- AWS Certified Solutions Architect (Associate or Professional), AWS Certified Machine Learning - Specialty, or AWS Certified Big Data is preferred.