Featured Post

The Quick and Easy Way to Analyze Numpy Arrays

Image
The quickest and easiest way to analyze NumPy arrays is by using the numpy.array() method. This method allows you to quickly and easily analyze the values contained in a numpy array. This method can also be used to find the sum, mean, standard deviation, max, min, and other useful analysis of the value contained within a numpy array. Sum You can find the sum of Numpy arrays using the np.sum() function.  For example:  import numpy as np  a = np.array([1,2,3,4,5])  b = np.array([6,7,8,9,10])  result = np.sum([a,b])  print(result)  # Output will be 55 Mean You can find the mean of a Numpy array using the np.mean() function. This function takes in an array as an argument and returns the mean of all the values in the array.  For example, the mean of a Numpy array of [1,2,3,4,5] would be  result = np.mean([1,2,3,4,5])  print(result)  #Output: 3.0 Standard Deviation To find the standard deviation of a Numpy array, you can use the NumPy std() function. This function takes in an array as a par

Oozie - Concepts And Architecture

Oozie is a workflow/coordination system that you can use to manage Apache Hadoop jobs. It is one of the main components of Oozie is the Oozie server — a web application that runs in a Java servlet container (the standard Oozie distribution is using Tomcat).

Oozie is a workflow management-server that works on the Oozie server.

Role of Oozie in Workflow Management in Hadoop Jobs

  1. This server supports reading and executing Workflows, Coordinators, Bundles, and SLA definitions. It implements a set of remote Web Services APIs that can be invoked from Oozie client components and third-party applications.
  2. Add a note where the execution of the server leverages a customizable database.
  3. This database contains Workflow, Coordinator, Bundle, and SLA definitions, as well as execution states and process variables.
  4. The list of currently supported databases includes MySQL, Oracle, and Apache Derby. The Oozie shared library component is located in the Oozie HOME directory and contains code used by the Oozie execution.

Oozie Architecture

oozie architecture


How to work with Oozie in Hadoop Framework

Oozie provides a command-line interface (CLI) that is based on a client component, which is a thin Java wrapper around Oozie Web Services APIs.

These APIs can also be used from third-party applications that have sufficient permissions.
A single Oozie server implements all four functional Oozie components:
  • Oozie Workflow 
  • Oozie Coordinator 
  • Oozie Bundle 
  • Oozie SLA 
  • Oozie server is described in this chapter, starting with what Oozie Workflow is and how you can use it.

Comments

Popular posts from this blog

How to Decode TLV Quickly

7 AWS Interview Questions asked in Infosys, TCS