Apache HDFS Review - why 3 stars?

Shlomi Lavi / updated: Jun 01, 2022

We publish unbiased reviews. Our opinions are our own and are not influenced by payments from advertisers. This content is reader-supported, which means if you leave your details with us we may earn a commission. Learn why ITQlick is free .

What is Apache HDFS?

Apache HDFS is a flexible open-source software module part of the Apache Hadoop project. HDFS provides high-throughput access to application data, handles large data sets, and runs on commodity hardware. The distributed file system has several features, and some are discussed below:

• Large Data Set Processing: With HDFS, users can store, move, delete, and organize large data sets, usually saved in 128MB blocks across several machines. The software can support millions of files at once and provides hundreds of nodes in a single cluster with high aggregate data bandwidth and scale.
• Data Replication: Users can store large files, in gigabytes, terabytes, and petabytes, across several machines in large clusters with HDFS. By storing these files as a sequence of blocks, HDFS replicates these blocks for fault tolerance in a write-once mode.
• File System Namespace: With HDFS, users can create traditional file organizations and create file directories for saving files. Users or applications can also create, move, remove, and rename files.
• NameNode and DataNode: HDFS features a NameNode, a controller server that regulates the file system namespace, grants clients access to files, and manages commands like opening, closing, and renaming file directories. The software also has DataNodes that serve read and write requests from clients.

The Apache HDFS was launched in 2009. The company has between 11 to 50 employees and has its headquarters in Baltimore, Maryland, USA.

Who is it best for?

The typical customers include the following business size: SMBs.

What is the actual cost?

The cost of license starts at $1,000 per license. ITQlick pricing score is 6.4 out of 10 (10 is most expensive). Access ITQlick pricing guide for Apache HDFS.

Pros

• Apache HDFS is open source and free to use
• The software can be deployed as a cloud solution and on-premise software and runs on commodity hardware
• Apache HDFS supports storing files in several formats
• It is fast and not prone to failure

Cons

• Occasionally, file replicas created for fault tolerance usually consume more space
• HDFS has a steep learning curve, especially for users not proficient in coding
• Sometimes, the system lags when nodes are shared

How it stacks up?

Access a head to head analysis of Apache HDFS vs alternative software solutions.

Frequently Asked Questions (FAQs)

Is Apache HDFS right for you or your business?

The Apache HDFS is an open-source distributed file system that can be deployed as a cloud solution and on-premise software. HDFS stores and processes big data and is suitable for large-scale companies across several industries. Companies like Twitter, eBay, and LinkedIn have used the Apache HDFS.