Python Software Developer
- Softcell Technologies
- 3 - 7 years
- Mumbai
- 1 month ago
- Email to a friend
- Report this job
Job Description
Key Responsibilities:
- Develop and maintain automated web scraping scripts using Python libraries such as BeautifulSoup, Scrapy, and Selenium.
- Optimize scraping pipelines for performance, scalability, and resource efficiency.
- Handle dynamic websites, CAPTCHA-solving, and implement IP rotation techniques for uninterrupted scraping.
- Process and clean raw data, ensuring accuracy and integrity in extracted datasets.
- Collaborate with cross-functional teams to understand data requirements and deliver actionable insights.
- Leverage APIs when web scraping is not feasible, managing authentication and request optimization.
- Document processes, pipelines, and troubleshooting steps for maintainable and reusable scraping solutions.
- Ensure compliance with legal and ethical web scraping practices, implementing security safeguards.
Requirements:
- Education:
Bachelors degree in Computer Science, Engineering, or a related field. - Experience:
2+ years of Python development experience, with at least 1 year focused on web scraping. - Technical Skills:
- Proficiency in Python and libraries like BeautifulSoup, Scrapy, and Selenium.
- Experience with regular expressions (Regex) for data parsing.
- Strong knowledge of HTTP protocols, cookies, headers, and user-agent rotation.
- Familiarity with databases (SQL and NoSQL) for storing scraped data.
- Hands-on experience with data manipulation libraries such as pandas and NumPy.
- Experience working with APIs and managing third-party integrations.
- Familiarity with version control systems like Git.
- Bonus Skills:
- Knowledge of containerization tools like Docker.
- Experience with distributed scraping solutions and task queues (e.g., Celery, RabbitMQ).
- Basic understanding of data visualization tools.
- Non-Technical Skills:
- Strong analytical and problem-solving skills.
- Excellent communication and documentation skills.
- Ability to work independently and collaboratively in a team environment.
- CANDIDATES AVAILABLE FOR FACE-TO-FACE INTERVIEWS ARE PREFERRED.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Software Development - Other
Employement Type: Full time
Contact Details:
Company: Softcell TechnologiesLocation(s): Mumbai
+ View Contact
Keyskills: Nosql Databases Selenium Numpy SQL Beautiful Soup Scrapy GIT Pandas
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in