Senior Software Engineer - Data Engineering
- TO THE NEW
- 4 - 6 years
- Noida, Gurugram
- 3 years ago
- Email to a friend
- Report this job
Job Description
- Review understand business requirements ensuring that development tasks are completed within the timeline that issues are fully tested with minimal defects
- Partner with software development team to implement best practices optimize performance of Data applications
- Collaborate across the company and interact with customers to define, design showcase new concepts solutions
- Research on new Big Data technologies, assessing maturity alignment of technology to business technology strategy
- Collaborate with developers to ensure that client needs are met
- Work in a rapid and agile development process to enable increased speed to market against a backdrop of appropriate controls
- Implement good development and testing standards to ensure quality of deliverables
- Understand, translate clients business challenges and concerns into a solution oriented discussion
Requirements
- At least 4 years of experience in design and development using Hadoop technology stack and programming languages
- Hands -on experience in 2 or more areas:
- Hadoop, HDFS, MR
- Spark Streaming, Spark SQL, Spark ML
- Kafka/Flume.
- Apache NiFi
- Worked with Hortonworks Data Platform
- Hive / Pig / Sqoop
- NoSQL Databases HBase/Cassandra/Neo4j/MongoDB
- Visualisation Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau, Pentaho
- Scrapy for crawling websites
- Good to have knowledge of Elastic Search
- Good to have understanding of Google Analytics data streaming
- Data security (Kerberos/Open LDAP/Knox/Ranger)
- Ability to visualise technology/industry trends
- Working knowledge of Big Data Integration with Third party/in house built Metadata Management, Data Quality, Master Data Management Solutions , Structured / Unstructured data
- Have been active in the community in terms of articles/blogs/speaking engagements at conferences
Job Classification
Industry: Advertising & MarketingFunctional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Full Stack Developer
Employement Type: Full time
Contact Details:
Company: TO THE NEWLocation(s): Noida, Gurugram
Keyskills: metadata Google Analytics data security Master data management Manager Technology MongoDB Data quality Apache big data SQL
Similar positions
TO THE NEW
TO THE NEW is a digital technology company providing digital transformation and product engineering services to ISVs, Consumer Internet, and large enterprises across the globe. We design & build digital platforms and products with Cloud and Data at the focal point by working on cutting-edge tech...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in