Assistant Manager - Big Data / Python
- Genpact India
- 4 to 7 Yrs
- Bengaluru
- 3 years ago
- Email to a friend
- Report this job
Job Description
*With a startup spirit and 90,000+ curious and courageous minds, we have the expertise to go deep with the world s biggest brands and we have fun doing it. Now, we re calling all you rule-breakers and risk-takers who see the world differently, and are bold enough to reinvent it. Come, transform with us.
Are you the one we are looking for
We are inviting applications for the role of AM, Sr. Big Data Engineer with Python
This role requires you to work on building a next gen Marketing platform bring data from both batch data pipelines as well as streaming, which could be real time and provide ways for Marketing to build signal driven programs.
Responsibilities- Experience designing and building highly scalable distributed and multi tenant systems
- Working experience with Hadoop ecosystem (HDFS, HBase, HIVE etc.), especially Spark
- Must have expertise with Hadoop architecture (Ability to set-up a Hadoop cluster from scratch and maintain, troubleshoot and tune by reviewing logs from various Hadoop services
- Working experience in building high performance data processing infrastructure considering concurrency, latency and efficiency by profiling, reviewing logs etc.
- Proficient understanding and tech-lead level experience in one or more programming languages (Python, Java etc.)
- Develop ETL pipelines to move data from source systems (CRM, weblogs, etc.) into data lake (HDFS, S3 etc.).
- Deep experience in developing data processing tasks using PySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.
- Expert knowledge of Python Coding. Should be aware of the end to end SDLC process in python world
- Have knowledge of ORM libraries
- Practical working experience with Big Data file systems and database like HDFS and HBase
- Must be proficient with tools such as Anaconda, Apache HTTP server, etc.
- Experience in building data pipelines using different data sources
- Very good communication skills; must be able to discuss the requirements effectively with a technical team of developers
- B.tech/M.Tech/Bsc./Msc./MCA
- A flexible, dedicated and solution orientated approach through periods of change and disruption.
- Should possess good interpersonal skills
- Digital marketing experiences a big plus
- Experience in Spark would be good to have
- Innovative and always looking for continuous improvement
- Communicate with clients on day-to-day basis to discuss project progress
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. For more information, visit www.genpact.com. Follow us on Twitter, Facebook, LinkedIn, and YouTube.
With a startup spirit and 90,000+ curious and courageous minds, we have the expertise to go deep with the world s biggest brands and we have fun doing it. Now, we re calling all you rule-breakers and risk-takers who see the world differently, and are bold enough to reinvent it. Come, transform with us.
Are you the one we are looking for
We are inviting applications for the role of AM, Sr. Big Data Engineer with Python
This role requires you to work on building a next gen Marketing platform bring data from both batch data pipelines as well as streaming, which could be real time and provide ways for Marketing to build signal driven programs.
Responsibilities- Experience designing and building highly scalable distributed and multi tenant systems
- Working experience with Hadoop ecosystem (HDFS, HBase, HIVE etc.), especially Spark
- Must have expertise with Hadoop architecture (Ability to set-up a Hadoop cluster from scratch and maintain, troubleshoot and tune by reviewing logs from various Hadoop services
- Working experience in building high performance data processing infrastructure considering concurrency, latency and efficiency by profiling, reviewing logs etc.
- Proficient understanding and tech-lead level experience in one or more programming languages (Python, Java etc.)
- Develop ETL pipelines to move data from source systems (CRM, weblogs, etc.) into data lake (HDFS, S3 etc.).
- Deep experience in developing data processing tasks using PySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.
- Expert knowledge of Python Coding. Should be aware of the end to end SDLC process in python world
- Have knowledge of ORM libraries
- Practical working experience with Big Data file systems and database like HDFS and HBase
- Must be proficient with tools such as Anaconda, Apache HTTP server, etc.
- Experience in building data pipelines using different data sources
- Very good communication skills; must be able to discuss the requirements effectively with a technical team of developers
- B.tech/M.Tech/Bsc./Msc./MCA
- A flexible, dedicated and solution orientated approach through periods of change and disruption.
- Should possess good interpersonal skills
- Digital marketing experiences a big plus
- Experience in Spark would be good to have
- Innovative and always looking for continuous improvement
- Communicate with clients on day-to-day basis to discuss project progress
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. For more information, visit www.genpact.com. Follow us on Twitter, Facebook, LinkedIn, and YouTube.
,Employement Category:
Employement Type: Full timeIndustry: IT - Software
Role Category: DBA / Datawarehousing
Functional Area: Not Applicable
Role/Responsibilies: Assistant Manager - Big Data / Python
Contact Details:
Company: Genpact IndiaLocation(s): Bengaluru
Similar positions
Genpact India
Genpact (NYSE: G) is a global professional services firm focused on delivering digital transformation for our clients, putting digital and data to work to create competitive advantage. We do this by integrating lean principles, design thinking, analytics and digital technologies with our domain and ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in
