Product Lead & Senior Python Engineer (CKAN & AI-Enabled Data Platforms)
- Abu Dhabi, United Arab Emirates
Posted 4 days ago
About the role
Location: Abu Dhabi
CTC: Up to 20000 AED/month
Role Overview
We are seeking an experienced Product Lead & Senior Python Engineer to lead the design, development, and delivery of CKAN-based data platforms. The role combines product ownership, backend engineering, and AI-enabled data solutions, working closely with stakeholders to build scalable, secure, and high-performance data systems.
You will own the CKAN roadmap, customize platform capabilities, and integrate modern APIs, pipelines, and AI/ML features to deliver business value.
Key Responsibilities
Product & Platform Leadership
- Own CKAN platform roadmap, backlog, and prioritization aligned with business KPIs
- Conduct stakeholder discovery to define dataset publishing workflows and governance rules
- Define requirements, acceptance criteria, and delivery milestones
Engineering & Development
- Develop, customize, and extend CKAN using Python and CKAN’s plugin architecture
- Build extensions for custom schemas, validators, actions, and workflow automation
- Design and maintain scalable backend services using FastAPI, Django, or Flask
- Implement CKAN Action API and REST integrations with internal/external systems
- Build and integrate REST & GraphQL APIs
Data & AI Integration
- Design and manage ETL/ELT pipelines
- Integrate AI/ML/NLP models for classification, tagging, summarization, and recommendations
- Optimize performance and reliability of data workflows
Security & Governance
- Implement authentication, authorization, and secure service-to-service integrations
- Ensure compliance with governance and data management standards
Required Qualifications
- 5+ years of professional Python development experience
- Strong hands-on experience with CKAN (plugins, actions, schema customization)
- Backend development expertise using FastAPI/Django/Flask
- Solid experience with PostgreSQL and Elasticsearch
- Experience designing and operating ETL/ELT pipelines
- Experience integrating AI/ML or NLP capabilities into production systems
Preferred Skills
- Product ownership or technical leadership experience
- Knowledge of cloud platforms (AWS/Azure/GCP)
- Containerization (Docker/Kubernetes)
- CI/CD and DevOps practices
- Strong problem-solving and stakeholder communication skills
Job Type: Full-time
Application Question(s):
- Do you have experience in Product Lead & Senior Python Engineer (CKAN & AI-Enabled Data Platforms)
- Salary expectations
- Notice period
Work Location: In person