Featured post

4 Layers of AWS Architecture a Quick Answer

I have collected real interview questions on AWS key architecture components. Those are S3, EC2, SQS, and SimpleDB. AWS is one of the most popular skills in the area of Cloud computing. Many companies are recruiting software developers to work on cloud computing.

AWS Key Architecture Components AWS is the top cloud platform. The knowledge of this helpful to learn other cloud platforms. Below are the questions asked in interviews recently.
What are the components involved in AWS?Amazon S3.With this, one can retrieve the key information which is occupied in creating cloud structural design, and the amount of produced information also can be stored in this component that is the consequence of the key specified.Amazon EC2. Helpful to run a large distributed system on the Hadoop cluster. Automatic parallelization and job scheduling can be achieved by this component.Amazon SQS. This component acts as a mediator between different controllers. Also worn for cushioning requirements those are obt…
Post a Comment

Hadoop: How to find which file is healthy

Hadoop provides file system health check utility which is called "fsck". Basically, it checks the health of all the files under a path It also checks the health of all the files under the '/'(root).
  • BIN/HADOOP fsck / - It checks the health of all the files
  • BIN/HADOOP fsck /test/ - It checks the health of files under the path
By default fsck utility cannot do anything for under replicated blocks and over replicated blocks. Hadoop itself heal the blocks.
Healthy file checking ides

 How to find which file is healthy

  • It prints out dot for each healthy file
  • It will print a message for each file, if it is not healthy, also for under replicated blocks, over replicated blocks, mis-replicated blocks, and corrupted blocks.
  • By default fsck utility cannot do anything for under replicated blocks and over replicated blocks. Hadoop itself heal the blocks.

How to delete corrupted blocks

  • BIN/HADOOP fsck -delete block-names
  • It will delete all corrupted blocks
  • BIN/HADOOP fsck -move block-names
  • It will move corrupted blocks to /lost directory
  • Other options we can use with fsck:
    • files
    • blocks
    • locations

Comments

Post a Comment

Thanks for your message. We will get back you.

Popular posts from this blog

Hyperledger Fabric: 20 Real Interview Questions

Image
I am practicing Hyperledger. This is one of the top listed blockchains. This architecture follows R3 Corda specifications. Sharing the interview questions with you that I have prepared for my interview.

Though Ethereum leads in the real-time applications. The latest Hyperledger version is now ready for production applications. It has now become stable for production applications.
The Hyperledger now backed by IBM. But, it is still an open source. These interview questions help you to read quickly. The below set of interview questions help you like a tutorial on Hyperledger fabric. Hyperledger Fabric Interview Questions1). What are Nodes?
In Hyperledger the communication entities are called Nodes.

2). What are the three different types of Nodes?
- Client Node
- Peer Node
- Order Node
The Client node initiates transactions. The peer node commits the transaction. The order node guarantees the delivery.

3). What is Channel?
A channel in Hyperledger is the subnet of the main blockchain. You c…
Read more

Python IF Statements Multiple Conditions Examples

Image
I shared how to write multiple if conditions (statements) in Python. These are the best examples useful for interviews and projects.
Many programmers confuse how to write IF conditions in Python. The below examples act as a handy guide for beginners and experienced.
Python IF Statements the Best Examples
IF, IFIF 'ELSE'IF 'or'IF 'and'Nested IFIF 'continue'IF 'break'
In Python,  the decision making logic you can write with IF condition. You can write multiple IF conditions (Single way decision). At the same time, you can write IF and ELSE conditions (Two-way decision).
Multiple IF conditions the best example.def main():         celsius = float(input("What is the Celsius temperature? "))         fahrenheit = 9/5 * celsius + 32         print("The temperature is", fahrenheit, "degrees Fahrenheit.")  # Print warnings for extreme temps  if fahrenheit > 90:  print("It's really hot out there. Be careful!")  if fahrenhe…
Read more

Best Machine Learning Book for Beginners

Image
You need a mixof different technologies for Data Science projects. Instead of learning many skills, just learn a few. The four main steps of any project are extracting the data, model development, artificial intelligence, and presentation. Attending interviews with many skills is not so easy. So keep the skills short.
A person with many skills can't perform all the work. You had better learn a few skills like Python, MATLAB, Tableau, and RDBMS. So that you can get a job quickly in the data-science project.
Out of Data Science skills, Machine learning is a new concept. Why because you can learn Python, like any other language. Tableau also the same. Here is the area that needs your 60% effort is Machine learning.  Machine Learning best book to start.

Related Posts How to write multiple IF-conditions in Python Simplified
Read more