Release Notes

Discover the new features, updates, and known limitations in this release of the HDFS Service

Release Notes for HDFS version 2.8.0-3.2.1

Updates

  • Updated SDK to version 0.57.3. For more information see release-notes for previous SDK releases:

Release Notes for HDFS version 2.7.0-3.2.1

Updates

  • Updated base-tech to version 3.2.1
  • Updated SDK to version 0.57.0. For more information see release-notes for previous SDK releases:

Features

  • Added CLI support for native hdfs base-tech commands such as dfs. Users can now execute commands via:
    dcos hdfs hdfs {cmd} {args}
    
    • For example:
    dcos hdfs hdfs dfs -mkdir /tmp
    dcos hdfs hdfs dfs -ls /
    
    • For the full list of executable commands, refer to HDFS docs
  • By upgrading the SDK, HDFS now comes with support for:
    • Quota enforcement
    • Node draining

Upgrading the DC/OS HDFS Package

  • This DC/OS package can be upgraded from the following versions:
    • 2.6.0-3.2.0
    • 2.5.0-2.6.0-cdh5.11.0
  • To upgrade HDFS, run the following command:
    dcos hdfs update start --package-version=2.7.0-3.2.1
    

Release Notes for HDFS version 2.6.0-3.2.0

Updates

  • Updated HDFS version to 3.2.0. Note: our package no longer includes Cloudera’s cdh variant
  • Updated Snappy library to version 1.1.4.
  • Updated the SDK to version 0.56.1
  • Oracle JDK is replaced with OpenJDK 8

Features

  • Added support for custom domains. See custom domains
  • Added support for DC/OS Storage Service (DSS). See DSS documentation
  • Added marathon service scheduler checks

Bug Fixes

  • Fixed a bug in Apache Derby related to the miscalculation of bytes read for a principal entry in the Kerberos keytab file. See HADOOP-16283).