Sr. Big Data Architect
Responsibilities:
Validate the architecture and provide details and shared ownership for the architecture of our next generation data warehousing system, leading and working hands-on towards implementation and delivery to production
Help lead the charge on a data warehouse/operational data store strategy, ensuring rapid delivery while taking responsibility for applying standards, principles, theories, and concepts
Responsible for design and delivery of data models, which power BI initiatives, dashboards, syndicated reporting, and ad-hoc data exploratory canvases for IMS solutions
Work with data architects on the logical data models and physical database designs optimized for performance, availability and reliability
Tuning and optimization of backend and frontend data operations
Serve as a query tuning and optimization technical expert, providing feedback to team
Design and develop ETL and master data management processes
Scripting and automation to support development, QA and production database environments and deployments to production
Define and help enforce data governance and security policy
Mentors development team members
Proactively helps to resolve difficult technical issues
Provide technical knowledge to teams during project discovery and architecture phases
Keep management informed of work activities and schedules
Assess new initiatives to determine the work effort and estimate the necessary time-to-completion
Document new development, procedures or test plans as needed
Participate in data builds and deployment efforts
Participate in projects through various phases
Performs other related duties as assigned
Partner with the business units to develop effective solutions that solve business challenges
Required Experience (in order of importance):
Hadoop, Hive, Impala, and related technologies
Spark 1.6 / 2.0
Maven/SBT
MPP, shared nothing database systems, NoSQL systems
Mesos, Yarn
Lambda architectures
Linux
Data Warehousing design and concepts
Minimum Education, Experience, & Specialized Knowledge Required:
Computer Science Degree
5
years strong native SQL skills
5
years strong experience in database and data warehousing concepts and techniques. Must understand: relational and dimensional modeling, star/snowflake schema design, BI, Data Warehouse operating environments and related technologies, ETL, MDM, and data governance practices.
5
years experience working in Linux
3
years experience with Hadoop, Hive, Impala, HBase, and related technologies
2
years strong experience with low latency (near real time) systems and working with Tb data sets, loading and processing billions of records per day
1
years' experience with MapReduce/YARN
2
years' experience with Spark
1
years experience with Lambda architectures
1
years experience with MPP, shared nothing database systems, and NoSQL systems
Ability to work in a fast-paced, team-oriented environment
Ability to complete the full lifecycle of software development and deliver on time
Ability to work with end-users to gather requirements and convert them to working documents
Strong interpersonal skills, including a positive, solution-oriented attitude
Must be passionate, flexible and innovative in utilizing the tools, their experience, and any other resources, to effectively deliver to very challenging and always changing business requirements with continuous success
Must be able to interface with various solution/business areas to understand the requirements and prepare documentation to support development
Healthcare and/or reference data experience is a plus
#LI-POST
#GLD
. Apply now!Estimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
