Bigdata + GCP Engineer
- Impetus Technologies
- 4 - 7 years
- Chennai
- 4 months ago
- Email to a friend
- Report this job
Job Description
Must have : Bigdata ,GCP (Bigquery, Dataproc)
- We are looking for energetic, high-performing and highly skilled data engineers to help shape our technology and product roadmap.
- You will be part of the fast-paced, entrepreneurial Global Campaign Tracking (GCT) team under Enterprise PersonalizationPortfolio focused on delivering the next generation of global marketing capabilities.
- The team is responsible for marketing campaign tracking of new accounts acquisition and bounty payments and leverages large scale data engineering technologies, such as such as Adobe Analytics, Google Analytics, SQL, PySpark, GCP, Big Query, Data Proc, Hive, Kafka & Java.
- Focus: Designs, develops, solves problems, debugs, evaluates, modifies, deploys, and documents software and systems that meet the needs of customer-facing applications, business applications, and/or internal end user applications.
Minimum Qualifications:
This high energy Engineer must have:
- A Bachelors degree in computer science, computer engineering, other technical discipline, or equivalent
- Hands-on expertise with application design, software development, and automated testing.
- Strong programming knowledge in SQL, PySpark, Data Proc, Big QueryHands-on experience in Big Data technologies (Spark, Hive)
- Understanding and experience with UNIX / Shell / Perl / Python scriptingDatabase query optimization and indexingWeb services design and implementation using REST / SOAP and Java is a plus.
- Experience collaborating with the business to drive requirements/Agile story analysis.
- Experience with design and coding across one or more platforms and languages as appropriate
- Bonus skills:Machine learning/data miningObject-oriented design and codingAdobe Marketing Campaign products
Roles and Responsibilities
- Develop and maintain large scale data processing pipeline using PySpark Data Proc, Big Query and SQL.
- Use Big Query and Data proc to migrate existing Hadoop/Spark/Hive workloads to Google Cloud.
- Proficient in Big Query to carry out batch and interactive data analysis.
- Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)
- Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality
- Enable the deployment, support, and monitoring of software across test, integration, and production environments
Job Classification
Industry: Software ProductFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Impetus TechnologiesLocation(s): Chennai
Keyskills: hive data application design scala pyspark sql cloud java gcp spark design shell scripting bigquery hadoop perl big data programming rest python software development automation testing machine learning analysis data engineering dataproc query optimization pro*c agile unix soap
Similar positions
Impetus Technologies
Impetus Technologies Impetus Technologies is a software products and services company focused on creating powerful and intelligent enterprises through deep data awareness, data integration and advanced data analytics. Our products and services are designed to empower the real-time data driven en...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in