Big Data Engineer- Spark/Pyspark
- Placement Whizzles
- 3 to 8 Yrs
- Hyderabad
- 5 months ago
- Email to a friend
- Report this job
Job Description
- As a Senior Software Engineer specializing in Big Data at Dun & Bradstreet in Hyderabad, you will play a crucial role in designing, developing, and optimizing data pipelines within our Big Data ecosystem. Your expertise in Apache Spark, Apache Airflow, and cloud-based infrastructures like AWS/GCP will be instrumental in driving innovation and efficiency in our data processing solutions. Your key responsibilities will include architecting and deploying scalable data pipelines, designing data processing solutions using technologies like Apache Spark and Hadoop, and managing cloud-based data infrastructure for optimal efficiency. Your proficiency in Python programming, along with your ability to create and manage workflows using Apache Airflow, will be essential in ensuring the smooth orchestration of data processing jobs. In addition to your technical skills, you will leverage your knowledge of Big Data architecture to enhance platform capabilities and optimize resource allocation. Your experience with Big Data technologies such as Hadoop, Spark, Hive, and cloud environments like GCP will be crucial in meeting the requirements of this role. Any hands-on experience with dataproc, NoSQL, and Graph databases will be considered a significant advantage. Collaboration and continuous learning are key aspects of this role, as you will work closely with data science teams to enhance platform skills and capabilities. Your ability to innovate, optimize workloads, and manage resources across multiple tenants will be essential in fulfilling service level agreements and driving the success of our global operations. If you are a bold and diverse thinker with a passion for data innovation and a minimum of 8 years of hands-on experience in Big Data technologies, we welcome you to join our dynamic team at Dun & Bradstreet. Be a part of our award-winning culture, where uncertainty turns into confidence, risk into opportunity, and potential into prosperity. Explore more about this exciting opportunity at dnb.com/careers and contribute to creating a better tomorrow with us.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: Big Data Engineer- Spark/PysparkContact Details:
Company: Dun & BradstreetLocation(s): Hyderabad+ View Contact
Keyskills: Python Apache Spark AWS GCP Hadoop NoSQL Graph databases DevOps
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Placement Whizzles
Placement Whizzles is a dynamic HR recruitment agency headquartered in Bengaluru, specializing in End To End Recruitment & Staffing Solutions, Executive Search, Workforce Solutions to simplify the hiring process by providing tailored recruitment solutions that align with our clients' specific ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in