4796 Data Engineer Python Aws jobs near me

Role Overview:

We are looking for a hands-on Full Stack AI & Data Engineer to build production-grade data pipelines, AI agents, and backend services on AWS using a modern pro-code engineering approach.

The ideal candidate should have strong Python and AWS experience, with hands-on exposure to PySpark, AWS Glue, Step Functions, S3, Athena, Amazon Bedrock, AgentCore and Strands, along with the ability to build backend APIs and microservices.

This role is suited for an engineer who enjoys working across Data + AI + Backend stack and can take a solution from design and development through deployment and productionization.

Key Responsibilities:

1. Data Engineering & AWS Pipelines

• Design and develop scalable data pipelines for ingesting data from REST APIs, databases, files and other enterprise data sources.
• Build data ingestion and transformation workflows using Python, PySpark and AWS Glue.
• Orchestrate pipelines using AWS Step Functions and other appropriate AWS services.
• Design S3-based data layers for raw, processed and curated data.
• Create and maintain Athena/Glue Catalog layers for querying and downstream consumption.

2. Backend & API Development

• Design and develop Python-based backend services and REST APIs
• Build microservices that can be consumed by AI agents and front-end applications.
• Develop integrations with enterprise systems and third-party APIs.
• Implement authentication, validation, error handling, logging and monitoring.
• Containerize and deploy backend services using appropriate AWS/cloud technologies.

3. AI Agent Development

• Design and build AI agents using Amazon Bedrock, AgentCore and Strands.
• Develop agents capable of interacting with enterprise data, APIs and backend services.
• Implement agent tools/function calling, workflows, context/state management and RAG where appropriate.
• Integrate LLMs with enterprise applications and data sources.
• Apply appropriate practices for prompt management, evaluation, security, observability and cost optimization.
• Develop reusable agent frameworks and components that can support multiple enterprise AI use cases.

4. Pro-Code Engineering & DevOps

• Develop solutions using clean, modular, reusable and testable code.
• Use Git and CI/CD practices for source control, code reviews and deployments.
• Follow configuration-driven development using YAML/JSON and environment-specific configuration.
• Have a good understanding of Infrastructure as Code (IaC) and cloud deployment practices.
• Terraform experience is preferred, particularly for provisioning and managing AWS infrastructure, but deep Terraform expertise is not mandatory.
• Follow enterprise standards around security, secrets management, logging, monitoring and access control.

Required Skills & Qualifications:

Must Have:

• Strong hands-on Python development experience.
• Strong AWS development experience.
• Hands-on experience building data pipelines / ETL processes.
• Experience with PySpark and preferably AWS Glue.
• Experience with S3 and Athena or equivalent cloud data-lake technologies.
• Experience with workflow orchestration such as AWS Step Functions.
• Experience developing REST APIs and backend services
• Hands-on experience developing LLM/GenAI applications or AI agents.
• Experience with Amazon Bedrock.
• Exposure to AgentCore and/or Strands is highly desirable.
• Strong understanding of Git, software engineering practices and CI/CD.

Good to Have:

• Terraform / Infrastructure as Code.
• Docker and containerized application deployment.
• RAG, vector databases and embeddings.
• LLM/AI evaluation and observability.
• AWS Lambda, API Gateway, EventBridge or DynamoDB.
• React/Next.js or experience integrating backend APIs with front-end applications.
• Experience integrating enterprise systems such as Salesforce, SAP, ServiceNow, etc.
• Experience with LangChain, LangGraph or similar agent frameworks.

Experience:

• 5+ years of overall software/data engineering experience, with meaningful hands-on experience in AWS, Python and modern data/AI engineering.
• Candidates with strong hands-on experience in AWS + Python + Data Engineering + GenAI/Agentic AI will be preferred over candidates with extensive experience in only one of these areas

Pay: ₹2,000,000.00 - ₹3,000,000.00 per year

Benefits:

• Flexible schedule
• Paid sick time
• Paid time off

Work Location: In person