Hadoop Developer (Remote Possible)

Hadoop Developer (Remote Possible) ( 220000RH ) Primary Location : UNITED STATES-NC-Charlotte Other Locations : UNITED STATES-NY-SYRACUSE Organization : Equitable Schedule : Full-time Description At Equitable, our power is in our people. We're individuals from different cultures and backgrounds. Those differences make us stronger as a team and a force for good in our communities. Here, you'll work with dynamic individuals, build your skills, and unleash new ways of working and thinking. Are you ready to join an organization that will help unlock your potential? Description of Responsibilities: + Serves as an influential intermediary between the assigned business clients and the development and other teams in the IT function and requires a developing knowledge in DataLake environment. + Plays an advocacy role on smaller less complex projects for the business clients in all phases of the solution development lifecycle for each of the critical stages, including: initiation, analysis, development, testing, implementation and post implementation follow up. + Works very closely with the testing team, using the user stories or requirements document as a critical guide, to ensure that issues are identified and fully resolved prior to roll out. + Delivers required solutions according to overall service levels and schedules on high priority projects. + Reviews quality standards required to ensure that developed applications meet or exceed the client's expectations. The base salary range for this position is $83,000 - $109,000. Actual base salaries vary based on skills, experience, and geographical location. In addition to base pay, Equitable provides compensation to reward performance with base salary increases, spot bonuses, and short-term incentive compensation opportunities. Eligibility for these programs depends on level and functional area of responsibility. Equitable Pay and Benefits: Equitable Total Rewards Program (\_id=A) Qualifications Required Qualifications: + 3 years of IT experience. + 2 years of extensive experience as a Hadoop Developer. + Development experience in Python coding using various versions and features (Spark framework on Python). + Create and optimize data pipelines in OOZIE Framework. + Experience in handling structured and unstructured/semi structured data(flat file, json, XML, binary files). + Knowledge of Linux and strong command line abilities. + Experience of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming. + Experience is sourcing data from RDBMS (Oracle, DB2, MySQL, etc.,) to data lake + In depth knowledge of Hadoop Architecture frameworks and various components such as HDFS, Hive, IMPALA, SQL, Sqoop, Python Scripting, Spark,UDF (User Defined Functions) development and map Reduce concepts. + Individual with strong communication, interpersonal and organizational skills. + Build Artifacts and deploy using CICD pipeline + Hands on experience in CDH/CDP distribution Preferred Qualifications: + Analyzing large volumes of data, optimize and performance tuning. + Good experience in Generating Statistics/extracts/reports from the Hadoop. + Knowledge of Bigdata platform in cloud (Azure), ADLS and distributed computing. + Experience in SQL Scikit-learn, Spark, Hive for Data Analysis and Model building. + Strong experience in Core Java. + Knowledge in Kafka/MQ. + Good understanding of NoSQL Data bases like HBASE is plus. + Good to have experience with Agile methodology + Knowledge with ELT tool like Syncsort DMX-h or equivalent. Skills required to ensure success include: Agile Methodologies: Knowledge of concept and principles of agile methodology; ability to apply appropriate agile approaches in the processes of software development and delivery. Application Design, Architecture: Knowledge of basic activities and deliverables of application design; ability to utilize application design methodologies, tools and techniques to convert business requirements and logical models into a technical application design. Documentation Architecture and Design: Knowledge of documentation architecture and design; ability to build efficient processes, use appropriate tools and technique , and create complete documentation portfolios for software or technology products. Software Development: Knowledge of software development tools and activities; ability to produce software products or systems in line with product requirements. System and Technology Integration : Knowledge of the features and facilities of systems; ability to integrate and communicate among applications, databases and technology platforms. Technical Writing/Documentation: Knowledge of technical writing; ability to write technical documents such as manuals, reports, guidelines or documents on standards, processes and applications. Diversity, Equity and Inclusion : Demonstrates a commitment to Diversity, Equity and Inclusion by treating everyone with respect and dignity, ensuring all voices are heard and advocating for change. ABOUT EQUITABLE At Equitable, we're a team of over ten thousand strong; committed to helping our clients secure their financial well-being so that they can pursue long and fulfilling lives. We turn challenges into opportunities by thinking, working, and leading differently - where everyone is a leader. We encourage every employee to leverage their unique talents to become a force for good at Equitable and in their local communities. We are continuously investing in our people by offering growth, internal mobility, comprehensive compensation and benefits to support overall well-being, flexibility, and a culture of collaboration and teamwork. We are looking for talented, dedicated, purposeful people who want to make an impact. Join Equitable and pursue a career with purpose. Equitable is committed to providing equal employment opportunities to our employees, applicants and candidates based on individual qualifications, without regard to race, color, religion, gender, gender identity and expression, age, national origin, mental or physical disabilities, sexual orientation, veteran status, genetic information or any other class protected by federal, state and local laws. NOTE: Equitable participates in the E-Verify program. If reasonable accommodation is needed to participate in the job application or interview process or to perform the essential job functions of this position, please contact Human Resources at or email us at . Req ID: 220000RH