All Projects → hakeemsm → hadoop.net

hakeemsm / hadoop.net

Licence: other
.NET port of hadoop core

Programming Languages

C#
18002 projects
c
50402 projects - #5 most used programming language
Protocol Buffer
295 projects
shell
77523 projects
AspectJ
31 projects
HTML
75241 projects

Disclaimer: The bits are super raw and the solution doesn't even compile, much less run. This is a WIP

This is a .NET port of The Apache Hadoop project v2.7.2 It is targeted for .NET 4.6.1 using C# 6 but the ultimate goal is to use .NET core for xplat. Please note that this is only the core Hadoop platform and as such it doesn't include the other components in the ecosystem such as Hive, Pig, Oozie, Flume etc. Below is a plan of action to get it up & running

1. Hadoop.Common has the core code for IO, HDFS, Yarn and Mapreduce. Clean this up first and make all tests pass

2. Hadoop.HDFS is the filesystem port. This needs to be taken up next

3. Get Hadoop.Yarn working followed by Hadoop.MapReduce

4. Work on porting ZooKeeper so it can be used as the orchestrator

5. Work on Hadoop.Tools to get the framework running on aws, openstack etc

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].