Skip to main content

The best Free mining tool that adds value to backup data

#data-mining-tool-that-adds-value-to-backup-data
#data-mining-tool-that-adds-value-to-backup-data:
What is data mining?
The next big thing in backup will be a business use case to mine the data being stored for useful information. It’s a shame all that data is just sitting there wasted unless a restore is required. It should be leveraged for other, more important things. This method is called Data Mining Technique.
For example, can you tell me how many instances of any single file is being stored across your organization? Probably not, but if it’s being backed up to a single-instance repository, the repository stores a single copy of that file object, and the index in the repository has the links and metadata about where the file came from and how many redundant copies exist.
By simply providing a search function into the repository, you would instantly be able to find out how many duplicate copies exist for every file you are backing up, and where they are coming from.
Knowing this information would give you a good idea of where to go to delete stale or useless data. The complete knowledge on Data mining is a plus point to start further on this. After all, the best way to solve the data sprawl issue in the first place is to delete any data that is either duplicate or not otherwise needed or valuable. Knowing what data is a good candidate to delete has always been the problem.

Tools available
I think there may be an opportunity to leverage those backups for some useful information. When you combine disk-based backup with data deduplication, the result is a single instance of all the valuable data in the organization. I can’t think of a better, more complete data source for mining.
  • With the right tools, the backup management team could analyze all kinds of useful information for the benefit of the organization, and the business value would be compelling since the data is already there, and the storage has already been purchased. 
  • The recent move away from tape backup to disk-based deduplication solutions for backup makes all this possible.
Being able to visualize the data from the backups would provide some unique insights. As an example, using the free WinDirStat tool

A best use case is, I noticed I am backing up multiple copies of my archived Outlook file, which in my case is more than 14GB in size. If you have an organization of hundreds or thousands of people similar to me, that adds up fast.
The below are the best questions to use Data Mining tool
Are you absolutely sure you are not storing and backing up anyone’s MP3 files? How about system backups? Do any of your backups contain unneeded swap files? How about stale log dumps from the database administrator (DBA) community? What about any useless TempDB data from the Oracle guys? Are you spending money on other solutions to find this information? Are you purchasing expensive tools for email compliance or audits?
Advantages of Data mining
The backup data could become a useful source for data mining, compliance and data archiving or data backup, and can also bring efficiency into data storage and data movement across the entire organization.

Comments

Popular posts from this blog

The best 5 differences of AWS EMR and Hadoop

With Amazon Elastic MapReduce (Amazon EMR) you can analyze and process vast amounts of data. It does this by distributing the computational work across a cluster of virtual servers running in the Amazon cloud. The cluster is managed using an open-source framework called Hadoop.

Amazon EMR has made enhancements to Hadoop and other open-source applications to work seamlessly with AWS. For example, Hadoop clusters running on Amazon EMR use EC2 instances as virtual Linux servers for the master and slave nodes, Amazon S3 for bulk storage of input and output data, and CloudWatch to monitor cluster performance and raise alarms.

You can also move data into and out of DynamoDB using Amazon EMR and Hive. All of this is orchestrated by Amazon EMR control software that launches and manages the Hadoop cluster. This process is called an Amazon EMR cluster.


What does Hadoop do...

Hadoop uses a distributed processing architecture called MapReduce in which a task is mapped to a set of servers for proce…

Top 20 ultimate ETL Questions really good for interviews

How to print/display the first line of a file?  there are many ways to do this. However the easiest way to display the first line of a file is using the [head] command.  $> head -1 file. Txt no prize in guessing that if you specify [head -2] then it would print first 2 records of the file.  another way can be by using [sed] command. [sed] is a very powerful text editor which can be used for various text manipulation purposes like this.  $> sed '2,$ d' file. Txt how does the above command work?  The 'd' parameter basically tells [sed] to delete all the records from display from line 2 to last line of the file (last line is represented by $ symbol). Of course it does not actually delete those lines from the file, it just does not display those lines in standard output screen. So you only see the remaining line which is the 1st line.  how to print/display the last line of a file?  the easiest way is to use the [tail] command.  $> tail -1 file. Txt if you want to do it using…

5 Things About AWS EC2 You Need to Focus!

Amazon Elastic Compute Cloud (Amazon EC2) - is a web service that provides resizable compute capacity in the cloud. It is designed to make web-scale cloud computing easier for developers.
Amazon EC2’s simple web service interface allows you to obtain and configure capacity with minimal friction.

The basic functions of EC2... 
It provides you with complete control of your computing resources and lets you run on Amazon’s proven computing environment.Amazon EC2 reduces the time required to obtain and boot new server instances to minutes, allowing you to quickly scale capacity, both up and down, as your computing requirements change.Amazon EC2 changes the economics of computing by allowing you to pay only for capacity that you actually use. Amazon EC2 provides developers the tools to build failure resilient applications and isolate themselves from common failure scenarios. 
Key Points for Interviews:
EC2 is the basic fundamental block around which the AWS are structured.EC2 provides remote ope…