Overview The Big Data Developer_AI plays a pivotal role within the organization's data engineering team, focusing on the design, development, and deployment of advanced big data solutions. This position is critical for leveraging vast datasets to derive actionable insights, improve decision-making, and support innovative AI-driven initiatives. As a Big Data Developer_AI, you will work with cutting-edge technologies such as Apache Spark, Hadoop, and various relational and non-relational databases to develop and maintain scalable data processing pipelines. Your expertise will not only facilitate real-time data processing but also assist in machine learning model development and optimization. Collaborating with data scientists, analysts, and stakeholders, you will ensure high data quality and performance, which is essential for driving the organization's strategic objectives. This role demands a combination of technical prowess, problem-solving skills, and an ability to translate complex data into meaningful insights, establishing itself as a cornerstone within our analytics landscape. Key Responsibilities Design and implement big data processing systems. Develop ETL processes for data extraction, transformation, and loading. Optimize data storage and processing for efficiency. Collaborate with data scientists on model development initiatives. Utilize distributed computing frameworks such as Apache Spark. Integrate machine learning algorithms into big data systems. Work on data cleaning and preprocessing tasks. Develop and maintain documentation for data processes. Monitor data pipeline performance and troubleshooting issues. Ensure data security and compliance with relevant regulations. Leverage cloud platforms (e.g., AWS, Azure) for big data solutions. Create data models and architecture for scalable systems. Work closely with stakeholders to gather requirements. Participate in code reviews and continuous improvement efforts. Stay updated on industry trends and big data technologies. Required Qualifications Bachelor's degree in Computer Science, Information Technology, or related field. 3+ years of experience in big data development. Strong expertise in Hadoop, Spark, and related technologies. Proficiency in programming languages such as Python or Java. Experience with SQL and NoSQL databases. Familiarity with data warehousing concepts and tools. Knowledge of data governance and security best practices. Experience with data visualization tools is a plus. Ability to work with large datasets and complex data structures. Strong analytical and problem-solving skills. Excellent communication and collaboration abilities. Experience with cloud computing platforms (e.g., AWS, Google Cloud). Understanding of machine learning concepts and algorithms. Ability to work in a fast-paced, agile environment. Certifications in big data technologies are preferred. Proven experience in project management is an advantage. Skills: python,java,data governance,data visualization,data warehousing,cloud computing (aws, google cloud),nosql,data analysis,machine learning,spark,sql proficiency,hadoop ecosystem,sql,hadoop,
Employement Category:
Employement Type: Full time Industry: IT Services & Consulting Role Category: Not Specified Functional Area: Not Specified Role/Responsibilies: Big Data Developer AI Job in Viraaj HR
Contact Details:
Company: Viraaj HR Solutions Location(s): Other Haryana