Lead Cloud Data Engineer
Job
Summary:
Are you a DevOps guru who is passionate for creating solutions using cutting-edge technologies? Do you excel under pressure? Can you summarize highly complex problems so that others can help you solve them? Does everyone turn to you for answers to tough questions? Do you instrument everything, collect data about data, and look for the correlation in everything? Do you like gathering evidence to base your decisions off of, but can use your gut, intuition and experience to make quick decisions when necessary? If you smile in the face of pressure, can work independently but are also a great team player, we're looking for you!As a Lead Cloud Data Engineer, you will design and securely develop custom data pipelines across a wide variety of technologies.
You will fully utilize your ability to rapidly ramp up on new technologies to solve complex problems at scale by implementing, troubleshooting, and optimizing code within these technologies ensuring proper security, design, and coding standards are followed.
Responsibilities:
Provide technical guidance and act as a point of escalation for large cloud projectsDevelop reusable patterns and frameworks as part of the engineering processDesign and engineer high-performance/large scale Data Engineering projects with extensive automation capability that conform to existing software practices to produce maintainable and secure code with automated testing in a continuous integration environment.
Ensure solutions support all functional and non-functional requirementsOversee operational support and maintenance of products and servicesAbility to lead discovery processes with stakeholders to identify business requirements and expected outcomesAbility to mentor to junior team membersCoordinate and collaborate with offshore teamsBasic
Qualifications:
Bachelor's degree in Computer Science, Engineering, Information Technology, or related field or equivalent work experience2 to 4 years of relevant IT work experience.
2 or more years of experience with AWS Cloud TechnologiesLeadership experience in large, cross-functional teams, influencing senior-level management and key stakeholders.
Ability to perform across multiple phases of development for multiple complex projects, including technical design, build, and end-to-end testingPassionate about delivering data engineering projects and features in a team environment even if the team size is 1.
Demonstrate the ability to quickly ramp on new technologies.
Troubleshooting skills, ability to determine impacts, ability to resolve complex issues, and ability to exercise sound judgment and initiative in stressful situations.
Strong oral and written communication and interpersonal skills.
Preferred
Qualifications:
Strong ability to rapidly ramp up on new technologies as in a day you may be using:
Python, Java, SQL, ShellFundamentals of Data Architecture and the Data LifecycleDatabase - Snowflake, Athena/Presto, Maria/PostGreNoSQL - Dynamodb, HBase, MongoQueuing Technology - Kafka, RabbitMQ, Redis, SQS, Kinesis Streams, Kinesis FirehoseData Processing - EMR, Spark, Glue, Spark Streaming/FlinkContainers - Docker, Docker Swarm, Docker ApplicationsCICD - Jenkins/Codebuild/GitLabSecurity - IAM roles, wire encryption, KMS, Kerberos, Authz, ADInfra as Code - Terraform, Cloud Formation, CDK.
Estimated Salary: $20 to $28 per hour based on qualifications.
Summary:
Are you a DevOps guru who is passionate for creating solutions using cutting-edge technologies? Do you excel under pressure? Can you summarize highly complex problems so that others can help you solve them? Does everyone turn to you for answers to tough questions? Do you instrument everything, collect data about data, and look for the correlation in everything? Do you like gathering evidence to base your decisions off of, but can use your gut, intuition and experience to make quick decisions when necessary? If you smile in the face of pressure, can work independently but are also a great team player, we're looking for you!As a Lead Cloud Data Engineer, you will design and securely develop custom data pipelines across a wide variety of technologies.
You will fully utilize your ability to rapidly ramp up on new technologies to solve complex problems at scale by implementing, troubleshooting, and optimizing code within these technologies ensuring proper security, design, and coding standards are followed.
Responsibilities:
Provide technical guidance and act as a point of escalation for large cloud projectsDevelop reusable patterns and frameworks as part of the engineering processDesign and engineer high-performance/large scale Data Engineering projects with extensive automation capability that conform to existing software practices to produce maintainable and secure code with automated testing in a continuous integration environment.
Ensure solutions support all functional and non-functional requirementsOversee operational support and maintenance of products and servicesAbility to lead discovery processes with stakeholders to identify business requirements and expected outcomesAbility to mentor to junior team membersCoordinate and collaborate with offshore teamsBasic
Qualifications:
Bachelor's degree in Computer Science, Engineering, Information Technology, or related field or equivalent work experience2 to 4 years of relevant IT work experience.
2 or more years of experience with AWS Cloud TechnologiesLeadership experience in large, cross-functional teams, influencing senior-level management and key stakeholders.
Ability to perform across multiple phases of development for multiple complex projects, including technical design, build, and end-to-end testingPassionate about delivering data engineering projects and features in a team environment even if the team size is 1.
Demonstrate the ability to quickly ramp on new technologies.
Troubleshooting skills, ability to determine impacts, ability to resolve complex issues, and ability to exercise sound judgment and initiative in stressful situations.
Strong oral and written communication and interpersonal skills.
Preferred
Qualifications:
Strong ability to rapidly ramp up on new technologies as in a day you may be using:
Python, Java, SQL, ShellFundamentals of Data Architecture and the Data LifecycleDatabase - Snowflake, Athena/Presto, Maria/PostGreNoSQL - Dynamodb, HBase, MongoQueuing Technology - Kafka, RabbitMQ, Redis, SQS, Kinesis Streams, Kinesis FirehoseData Processing - EMR, Spark, Glue, Spark Streaming/FlinkContainers - Docker, Docker Swarm, Docker ApplicationsCICD - Jenkins/Codebuild/GitLabSecurity - IAM roles, wire encryption, KMS, Kerberos, Authz, ADInfra as Code - Terraform, Cloud Formation, CDK.
Estimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
