Data Engineer | Python Development
- Pradeepit Consulting
- 3 - 8 years
- Hyderabad
- 14 days ago
- Email to a friend
- Report this job
Job Description
Data Engineer with Python development experience
Experience: 3+ Years
Mode: Hybrid (2-3 days/week)
Location: Hyderabad
Key Responsibilities
- Develop, test, and deploy data processing pipelines using AWS Serverless technologies such as AWS Lambda, Step Functions, DynamoDB, and S3.
- Implement ETL processes to transform and process structured and unstructured data eiciently.
- Collaborate with business analysts and other developers to understand requirements and deliver solutions that meet business needs.
- Write clean, maintainable, and well-documented code following best practices.
- Monitor and optimize the performance and cost of serverless applications.
- Ensure high availability and reliability of the pipeline through proper design and error handling mechanisms.
- Troubleshoot and debug issues in serverless applications and data workows.
- Stay up-to-date with emerging technologies in the AWS and serverless ecosystem to recommend improvements.
Required Skills and Experience - 3-5 years of hands-on Python development experience, including experience with libraries like boto3, Pandas, or similar tools for data processing.
- Strong knowledge of AWS services, especially Lambda, S3, DynamoDB, Step Functions, SNS, SQS, and API Gateway.
- Experience building data pipelines or workows to process and transform large datasets.
- Familiarity with serverless architecture and event-driven programming.
- Knowledge of best practices for designing secure and scalable serverless applications.
- Prociency in version control systems (e.g., Git) and collaboration tools.
- Understanding of CI/CD pipelines and DevOps practices.
Strong debugging and problem-solving skills. - Familiarity with database systems, both SQL (e.g., RDS) and NoSQL (e.g., DynamoDB).
Preferred Qualications - AWS certications (e.g., AWS Certied Developer Associate or AWS Certied Solutions Architect Associate).
- Familiarity with testing frameworks (e.g., pytest) and ensuring test coverage for Python applications.
- Experience with Infrastructure as Code (IaC) tools such as AWS CDK, CloudFormation.
- Knowledge of monitoring and logging tools .
Apply for Position
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time
Contact Details:
Company: Pradeepit ConsultingLocation(s): Hyderabad
Keyskills: AWS Python s3 Metadata Workflow Serverless Architecture Version Control Ci/Cd SQL lambda git NoSQL Relational Database Management System Data Pipeline Relational Databases Data Manipulation Dynamo Db Pandas Nosql Databases Data Processing Data Crunching Boto3
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in