Aws Data Engineer

2 weeks ago
Job Code

JD-20265

JOB DESCRIPTION
    At PwC - AC, as an AWS Manger, the candidate will interact with Offshore Manager/ Onsite Business Analyst to understand the requirements and the candidate is responsible for end-to-end implementation of Cloud data engineering solutions like Enterprise Data lake, Data hub in AWS. The candidate should have strong experience in AWS cloud technology. Strong in planning and organization skills. Ability to work as cloud developer/lead on an agile team and provide automated cloud solutions. Years of Experience: Candidates with 8-12 years of hands on experience Position Requirements: Must Have: ● Experience in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutions ● Strong expertise in end-to-end implementation of Cloud data engineering solutions like Enterprise Data lake, Data hub in AWS ● Proficient in Lambda or Kappa Architectures ● Should be aware of Data Management concepts and Data Modelling ● Strong AWS hands-on expertise with a programming background preferably Python/Scala ● Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory ● Strong experience in AWS compute services like AWS EMR, Glue and storage services like S3, Redshift & Dynamodb ● Good experience with any one of the AWS Streaming Services like AWS Kinesis, AWS SQS and AWS MSK ● Troubleshooting and Performance tuning experience in Spark framework - Spark core, Sql and Spark Streaming ● Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit ● Experience with AWS CloudWatch, AWS Cloud Trail, AWS Account Config, AWS Config Rules ● Good knowledge in AWS Security and AWS Key management ● Strong understanding of Cloud data migration processes, methods and project lifecycle ● Good analytical & problem-solving skills ● Good communication and presentation skills Desired Knowledge / Skills: ● Experience in building stream-processing systems, using solutions such as Storm or Spark-Streaming ● Experience in Big Data ML toolkits, such as Mahout, SparkML, or H2O ● Knowledge in Python ● Worked in Offshore / Onsite Engagements ● Experience in one of the flow tools like Airflow, Nifi or Luigi ● Experience in AWS services like STEP & Lambda ● Knowledge in Azure Cloud Services ● Experience in Azure Cloud Service Professional and Educational Background: ● BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA
Experience Required

2 - 12 Years

Industry Type

IT

Employment Type

Permanent

Location

India

Apply Now    
Nityo Connect

Welcome to Nityo Infotech

I am Nityo Infotech’s virtual assistant. How can I help you today?