AWS Spark ETL Developer
Want to leverage your experience and development skills in the Healthcare industry ? Look no further, CGI is seeking a AWS Spark ETL Developer who can bring expertise and industry best practices to define better development and Engineering approaches.
Preferred locations are Lafayette LA, Bloomfield CT, or New York NY!
This is an exciting opportunity to augment your current skills, as well as, learn new technologies.
If you are looking for a new challenge and want to make a difference in the Healthcare Industry, this role is for you.
Your future duties and responsibilities
You will be a key contributor to our Services practice and will have the below responsibilities:
Clearly identify the essential qualification vs the desired qualifications.
Work with technical development team and team lead to understand desired application capabilities.
Continuously improve software engineering practices.
Work within and across Agile teams to test and support technical solutions across a full-stack of development tools and technologies.
Develop applications in AWS – data and analytics technologies including but not limited to Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM.
Build ETL pipelines using Apache Spark.
Conduct development using application development by lifecycles, & continuous integration/deployment practices.
Integrate open source components into data-analytic solutions
Work with vendors to enhance tool capabilities to meet enterprise needs
Continuously learn & share learnings with others
Required qualifications to be successful in this role
At least 8 years of solid, diverse work experience in IT Industry, with a minimum of 8 years' experience in application program development
Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM.
Strong knowledge of apache Spark and hands on development experience.
Proficient in at least one programming language (Python, Scala, Java etc)
Experience in ETL / Data application development and version control systems such as Git.
Knowledge of application development lifecycles, & continuous integration/deployment practices.
3+ years experience delivering and operating large scale, highly visible distributed systems.
2+ years of experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM
3+ years of Python/Scala/Java etc Programming 3
2+ years of Spark
2+ years of SQL- Simple to Complex SQL analysis
Knowledge of IAC using terraform is preferred.
Snowflake MPP and graph database experience is preferred but not mandatory.
Educational Expectations: Bachelor's Degree in Computer Science or Related Field.
CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to: skill set level; experience and training; and licensure and
certifications. CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $84,000 – $176,300
At CGI we call our professionals "members" to reinforce that all who join our team are, as owners, empowered to participate in the challenges and rewards that come from building a world-class company. CGI's benefits include:
• Competitive base salaries
• Eligibility to participate in an attractive Share Purchase Plan (SPP) in which the company matches dollar-for-dollar contributions made by eligible employees, up to a maximum, for their job category
• 401(k) Plan and Profit Participation for eligible members
• Generous holidays, vacation, and sick leave plans
• Comprehensive insurance plans that include, among other benefits, medical, dental, vision, life, disability, out-of-county emergency coverage in all countries of employment;
• Back-up child care, Pet insurance, a Member Assistance Program, a 529 college savings program, a personal financial management tool, lifestyle management programs and more
Insights you can act on
While technology is at the heart of our clients' digital transformation, we understand that people are at the heart of business success.
When you join CGI, you become a trusted advisor, collaborating with colleagues and clients to bring forward actionable insights that deliver meaningful and sustainable outcomes. We call our employees "members" because they are CGI shareholders and owners and owners who enjoy working and growing together to build a company we are proud of. This has been our Dream since 1976, and it has brought us to where we are today – one of the world's largest independent providers of IT and business consulting services.
At CGI, we recognize the richness that diversity brings. We strive to create a work culture where all belong and collaborate with clients in building more inclusive communities. As an equal-opportunity employer, we want to empower all our members to succeed and grow. If you require an accommodation at any point during the recruitment process, please let us know. We will be happy to assist.
Ready to become part of our success story? Join CGI – where your ideas and actions make a difference.
Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status, political affiliation, genetic information, or any other legally protected status or characteristics.
CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at US_Employment_Compliance@cgi.com . You will need to reference the requisition number of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a requisition number will not be returned.
We make it easy to translate military experience and skills! Click here to be directed to our site that is dedicated to veterans and transitioning service members.
All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held. CGI will consider for employment qualified applicants with arrests and conviction records in accordance with all local regulations and ordinances.
CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI's legal duty to furnish information.
- Spark SQL