Details: Needs strong resource with Hadoop and HDFS (Files System Strucutre under which Hadoop runs). Will not be typical project but will span multiple domains within the retail space to build scorecards in the business. There will be a lot of business interaction so need strong communciation skills. Resource Need(s): 1 Developer DQ Platform Developer Job Description and Responsibilities:Responsible for developing and supporting the DQ Foundational Platform data sourcing needs with Datameer in a Hadoop based Distributed environment. The person holding this position will be responsible for: • Develop data sourcing routines from a host of SORs into the Hadoop HDFS data repository.• Assimilate and document transformation (business) rules during and after the Load process.• Show a high degree of confidence in handling issues with the new HDFS/MapReduce technology• Work in tandem with the Administrator to enable the platform• Work with the Datameer vendor to be up-to-date on releases, features and ensure a state-of-the-art platform for ELT is established• Help the admin to carve out space/time for patches, any PoC, Pilot and new environment builds• Manage code production, build and release• May require some after-hour responsibilities as well (as and when needed) Required Skills: "Must" have these skills to be minimally qualified• Knowledge and Experience in Big Data Space working with very large datasets• Experience with Distributed Data Modeling and related normalization• Working knowledge of HDFS and MapReduce• Working knowledge of Datameer Analytic tool and its administrative features• Strong Database and SQL skills with any regular RDMBS• Strong working knowledge of Distributed systems• Good working knowledge of Hadoop based Job Scheduling and Monitoring tools• Experience with preparing and managing extract, load and tranform jobs.• Must be able to work with multiple projects/tasks and the ability to prioritize on the fly Desired Skills: "Optional" but nice to have skillsStrong Experience with• Large scale risk management implementations• Datamarts or data warehouses• Working knowledge of MetaCenter metadata tool and knowledge of metadata• Java development• MapReduce• Teradata• Netezza
No comments:
Post a Comment