Senior Python Developer(Web Scraping &)
- Kpr sugar apperals
- 4 to 8 Yrs
- Other Maharashtra
- 2 months ago
- Email to a friend
- Report this job
Job Description
- Job Title: Senior Python Engineer (Web Scraping & Automation Expert) Experience-4yrs To 5yrs Job Description: We are seeking a highly skilled RPA Engineer for an AI-driven automated web-scraping and form-filling solution. The ideal candidate will focus on designing and implementing an end-to-end automation system that autonomously scrapes web content, navigates web pages, fills forms, writes code, compiles it, and debugs it with minimal user intervention. This solution should also include asynchronous build processing, monitoring capabilities, and nightly deployments with error reporting and dashboard analytics. Key Responsibilities: 1. Design and implement an AI-based system for web scraping, automated form filling, and code generation. 2. Develop automation scripts using Selenium or similar technologies that can autonomously traverse websites and handle multi-page forms. 3. Integrate GenAI tools like OpenAI to enhance the automation process by intelligently generating, compiling, and debugging scripts. 4. Set up and maintain a repository for scripts, with nightly testing, validation, and automatic correction as needed. 5. Deploy automation builds using Docker or similar container technologies to ensure scalability and reliability. 6. Develop an asynchronous build queuing system that allows multiple users to initiate automation builds concurrently without bottlenecks. 7. Design monitoring, logging, and dashboard solutions to ensure 100% error-free automation completion rates and maintain transparency. 8. Ensure scalability, stability, and performance optimization of the automation system. Required Skills & Qualifications: - Web Scraping Expertise: Strong experience in web scraping technologies and techniques, including handling dynamic content, captchas, and multi-page navigation. - Automation Technologies: Proficiency in tools like Selenium, Puppeteer, Playwright, or similar for web traversal and automation scripting. - GenAI Integration: Experience working with AI language models (e.g., OpenAI's GPT), with an understanding of using AI to generate, compile, refine, and debug code. - Scaling Automation: Experience in scaling automation systems, optimising selenium or related scripting tools for high efficiency. - Containerization: Knowledge of Docker for deploying and maintaining scalable automation systems. - Programming Skills: Strong programming skills in Python or JavaScript, especially in writing and optimising web scraping and automation scripts. - CI/CD and Version Control: Experience in managing scripts using Git, implementing CI/CD pipelines for automated testing, deployment, and maintenance of scripts. - Error Handling and Debugging: Experience with implementing robust error handling, testing, and debugging in automation workflows. - Logging and Monitoring: Experience with setting up logging and monitoring frameworks to track the status of automation processes, including building dashboards for visual reporting. - Build Management: Ability to develop asynchronous build queuing systems to support simultaneous multi-user build initiation. Preferred Skills: - Experience with different RPA (Robotic Process Automation) tools. - Experience with cloud services like AWS, GCP, or Azure for deploying and managing automation workloads. - Familiarity with continuous testing frameworks, automated error detection, and self-healing scripts. - Strong understanding of multi-threading and concurrency. - Knowledge of integrating blockchain or secure logging mechanisms to maintain integrity and audit trails.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & Consulting
Role Category: Not Specified
Functional Area: Not Specified
Role/Responsibilies: Senior Python Developer(Web Scraping &)
Contact Details:
Company: Stark Digital MediaLocation(s): Other Maharashtra
+ View Contact
Keyskills: Containerization Build Management Version Control Debugging Logging Monitoring
Fraud Alert to job seekers!
₹ Not Specified
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in