Home > cloudera, hadoop cluster > Deploying a Custom Patch Parcel Using Cloudera Manager

Deploying a Custom Patch Parcel Using Cloudera Manager

Following are the steps to install and deploy a patched parcel received from Cloudera Support.

Download the Patched Parcel
1. Download the .parcel and the associated manifest.json

  • Both files are necessary
  • Do not edit the manifest.json

2. Create a local server to host the .parcel and manifest.json so that Cloudera Manager sees and ingests them to its own Parcel Repository.

3. The Cloudera Documentation details a Local Parcel Repository:

Method 1: Creating a Temporary Repository:

Follow the Instructions under Cloudera Documentation: Creating a Temporary Remote Repository
Follow the Instructions under Cloudera Documentation: Configuring the Cloudera Manager Server to Use the Parcel URL

To create a disposable local repository to deploy the parcel once: It is convenient to perform this on the same host that runs Cloudera Manager, or a Gateway role. In this example, python SimpleHTTPServer is used from a specific directory (select as desired).

  1. Download the patched .parcel and manifest.json as provided in a secure link from Cloudera Support
  2. Copy the .parcel and manifest.json to a desired location on the server.

Example:
“/tmp/parcel”

This is the directory from which the Python SimpleHTTPServer serves out files:

$ mkdir /tmp/parcel
$ cp /home/user/Downloads/patchparcel/CDH-4.5.0.p234.parcel /tmp/parcel/
$ cp /home/user/Downloads/patchparcel/manifest.json /tmp/parcel/
  1. Determine a port that the system is not listening on (for example, port 8900). This is passed into the SimpleHTTPServer command below.
  2. Start a Python SimpleHTTPServer to serve these two files from the newly created directory:
$ cd /tmp/parcel
$ python -m SimpleHTTPServer 8900

Serving HTTP on 0.0.0.0 port 8900 ...
  1. Confirm this hosted parcel directory is reachable by going to http://&lt;server>:<port> using a browser. The links for the .parcel and the manifest.json display as shown in the screenshot below.

Configuring Cloudera Manager to use the Repository:

Add the server as a Remote Parcel Repository in Cloudera Manager:
  1. In the Cloudera Manager Admin Console, go to Administration > Settings > Parcels
  2. Under Remote Parcel Repository URLs, click the to add a new URL
  3. Enter http://&lt;server>:<port> in the new location
  1. Click Save Changes

Download, Distribute and/or Activate the Patch Parcel:

  1. Use the published instructions in Using Parcels to set the Cloudera Manager.
  2. Check for New Parcels to cause Cloudera Manager to find this patch parcel and note that it is available in the temporary SimpleHTTPServer.

Method 2: Using /opt/cloudera/parcel-repo directory on the Cloudera Manager Server

1. Copy the .patch file under /opt/cloudera/parcel-repo directory on the Cloudera Manager Server

2. $ sha1sum /opt/cloudera/parcel-repo/CDH-patch-file.parcel | cut -d ‘ ‘ -f 1 > /opt/cloudera/parcel-repo/CDH-patch-file.parcel.sha

3. $ chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo/CDH-patch-file.parcel /opt/cloudera/parcel-repo/CDH-patch-file.parcel.sha

4. In Cloudera Manager check for Patch Parcel to appear

Note: replace CDH-patch-file.parcel with the actual filename of the .patch file

 

Advertisements
Categories: cloudera, hadoop cluster
  1. No comments yet.
  1. No trackbacks yet.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

w

Connecting to %s

%d bloggers like this: