Posts

Showing posts from October, 2015

Featured Post

SQL Interview Success: Unlocking the Top 5 Frequently Asked Queries

Image
 Here are the five top commonly asked SQL queries in the interviews. These you can expect in Data Analyst, or, Data Engineer interviews. Top SQL Queries for Interviews 01. Joins The commonly asked question pertains to providing two tables, determining the number of rows that will return on various join types, and the resultant. Table1 -------- id ---- 1 1 2 3 Table2 -------- id ---- 1 3 1 NULL Output ------- Inner join --------------- 5 rows will return The result will be: =============== 1  1 1   1 1   1 1    1 3    3 02. Substring and Concat Here, we need to write an SQL query to make the upper case of the first letter and the small case of the remaining letter. Table1 ------ ename ===== raJu venKat kRIshna Solution: ========== SELECT CONCAT(UPPER(SUBSTRING(name, 1, 1)), LOWER(SUBSTRING(name, 2))) AS capitalized_name FROM Table1; 03. Case statement SQL Query ========= SELECT Code1, Code2,      CASE         WHEN Code1 = 'A' AND Code2 = 'AA' THEN "A" | "A

How Ruby On Rails Used for Web Development

Image
Since its debut in 2004, Ruby on Rails has rapidly become one of the most powerful and popular frameworks for building dynamic web applications. Everyone from scrappy startups to huge companies have used Rails: 3 7signals, GitHub, Shopify, Scribd, Twitter, LivingSocial, Groupon, Hulu, the Yellow Pages—the list of sites using Rails goes on and on . There are also many web development shops that specialize in Rails, such as ENTP, thoughtbot, Pivotal Labs, and Hashrocket, plus innumerable independent consultants, trainers, and contractors. (Career in Ruby On Rails ) What makes Rails so great? First of all, Ruby on Rails is 100 percent open-source, available under the permissive MIT License, and as a result it also costs nothing to download or use.  Rails also owes much of its success to its elegant and compact design; by exploiting the malleability of the underlying Ruby language, Rails effectively creates a domain-specific language for writing web applications. As a result, many

What is "Learning Algorithm" in Machine Learning

Image
#What is machine learning algorithm Just a basics on Machine Learning Alice has just begun taking a course on machine learning. She knows that at the end of the course, she will be expected to have “learned”all about this topic. A common way of gauging whether or not shehas learned is for her teacher, Bob, to give her a exam. She has done well at learning if she does well on the exam. But what makes a reasonable exam? If Bob spends the entire semester talking about machine learning, and then gives Alice an exam on History of Pottery, then Alice’s performance on this exam will not be representative of her learning. On the other hand, if the  (The general supervised approach to machine learning: a learning algorithm reads in training data and computes a learned function f . This function can then automatically label future text examples .) exam only asks questions that Bob has answered exactly during lectures, then this is also a bad test of Alice’s learning, especially if it

Top 10 SCALA Quiz Questions for Programmers

Image
Scala is an acronym for “Scalable Language” . This means that Scala grows with you. You can play with it by typing one-line expressions and observing the results. But you can also rely on it for large mission-critical systems , as many companies, including Twitter, LinkedIn, or Intel does. To some, Scala feels like a scripting language. Its syntax is a concise and low ceremony; its types get out of the way because the compiler can infer them. There are a REPL and IDE worksheets for quick feedback. Developers like it so much that Scala won the ScriptBowl contest at the 2012 JavaOne conference. At the same time, Scala is the preferred workhorse language for many mission-critical server systems. The generated code is on a par with Java’s and its precise typing means that many problems are caught at compile-time rather than after deployment. ✅ SCALA Quiz Link At the root, the language’s scalability is the result of a careful integration of object-oriented and functional language concepts

Quick Quiz on Machine learning

Image
According to Coursera-Machine learning is the science of getting computers to act without being explicitly programmed. In the past decade, machine learning has given us self-driving cars, practical speech recognition, effective web search, and a vastly improved understanding of the human genome. Real Meaning of Machine Learning Machine learning is so pervasive today that you probably use it dozens of times a day without knowing it. Many researchers also think it is the best way to make progress towards human-level AI. In this class, you will learn about the most effective machine learning techniques, and gain practice implementing them and getting them to work for yourself. Photo credit: Srini Role of Machine Learning More importantly, you'll learn about not only the theoretical underpinnings of learning but also gain the practical know-how needed to quickly and powerfully apply these techniques to new problems. Finally, you'll learn about some of Silicon Valley

How to get your next stunning dream job in Machine Learning

Image
Machine learning is the science of getting computers to act without being explicitly programmed. In the past decade, machine learning has given us self-driving cars, practical speech recognition, effective web search, and a vastly improved understanding of the human genome. Dream Job in Machine Learning Machine learning is so pervasive today that you probably use it dozens of times a day without knowing it. Many researchers also think it is the best way to make progress towards human-level AI. Related: Course on Machine Learning In this class, you will learn about the most effective machine learning techniques, and gain practice implementing them and getting them to work for yourself. More importantly, you'll learn about not only the theoretical underpinnings of learning, but also gain the practical know-how needed to quickly and powerfully apply these techniques to new problems. Finally, you'll learn about some of Silicon Valley's best practices in innovation

Daily use AWS File Commands

Image
The AWS Command Line Interface (CLI) is a unified tool to manage your AWS services. With just one tool to download and configure, you can control multiple AWS services from the command line and automate them through scripts. The AWS CLI introduces a new set of simple file commands for efficient file transfers to and from Amazon S3. Daily use AWS file commands $ aws ec2 describe-instances … $ aws ec2 start-instances --instance-ids i-1348636c … $ aws sns publish --topic-arn arn:aws:sns:us-east-1:546419318123:OperationsError --message "Script Failure" … $ aws sqs receive-message --queue-url https://queue.amazonaws.com/546419318123/Test … $ aws help $ aws autoscaling help $ aws autoscaling create-auto-scaling-group help $ aws s3 ls s3://mybucket         LastWriteTime            Length Name         ------------             ------ ----                                             PRE myfolder/ 2013-09-03 10:00:00           1234 myfile.txt …

Skills needed for NoSQL Data engineer

Image
The following Skills are needed to become successful NoSQL data engineer. NoSQL Skills Skills You Need to Become NoSQL Developer 3 + years of practical experience with distributed data analysis systems using parallel processes such as Hadoop. Experience working with batch processing/ real-time systems using various open source technologies like Solr, Hadoop, NoSQL, Spark, Hive, etc. Knowledgeable about data modeling, data access, and data storage techniques Experience in Linux or similar system is preferred Experience on MySQL, NoSQL and storage software is a plus Check here... NoSQL jobs skills and experience required Related:   NoSQL Interview Questions

Amazon Web Service Import/Export Commands

In the process like Hadoop cluster, which is already installed on CLOUD, the main input for data processing is huge volume of data. The big questions is how to send data to CLOUD from local machine. It is NOT so easy to send huge volume of data to CLOUD through network. AWS Import or Export AWS introduced new feature called Import/Export, so that you can send hard drive to AWS, they will upload your data to S3 storage . Different calculations: How networking causes hurdle to move data to cloud? A) Your internet speed is 1.544 MBPS it takes 82 days - So your data is 100 GB or more, based on your net speed you need to go for Import/Export. Your internet speed is 10 MBPS it takes 13 days - So your data is 600 GB or more, based on your net speed you need to go for Import/Export.

Aws QuickSight quick tutorial

Image
Amazon QuickSight is a very fast, cloud-powered business intelligence (BI) service that makes it easy for all employees to build visualizations, perform ad-hoc analysis, and quickly get business insights from their data. Amazon QuickSight   Architecture uses a new, Super-fast, Parallel, In-memory Calculation Engine (“SPICE”) to perform advanced calculations and render visualizations rapidly. Amazon QuickSight integrates automatically with AWS data services, enables organizations to scale to hundreds of thousands of users, and delivers fast and responsive query performance to them via SPICE’s query engine. At one-tenth the cost of traditional solutions, Amazon QuickSight enables you to deliver rich BI functionality to everyone in your organization. Easily connect Amazon QuickSight to AWS data services, including Amazon Redshift, Amazon RDS, Amazon Aurora, Amazon EMR, Amazon DynamoDB, Amazon S3, and Amazon Kinesis; upload CSV, TSV and spreadsheet files; or connect to th

How Communication Services happen in CLOUD

Image
(Cloud computing Jobs) For service developers, making services available in the cloud depends on the type of service and the device(s) being used to access it. The process may be as simple as a user clicking on the required web page, or could involve an application using an API accessing the services in the cloud. Telcos are starting to use clouds to release their own services and those developed by others, but using Telco infrastructure and data. The expectation is that the Telco’s communications infrastructure provides a revenue generating opportunity. Using the Communications Services When in the cloud, communications services can extend their capabilities, or stand alone as service offerings, or provide new interactivity capabilities to current services. Cloud-based communications services enable businesses to embed communications capabilities into business applications,such as Enterprise Resource Planning (ERP) and Customer Relationship Management (CRM) systems. For “o

5 Key Services on AWS Cloud computing

Image
Amazon web services offers 5 services on its cloud computing. Top AWS Services Store Files Store Files:  AWS provides highly scalable, reliable, secure, fast storage for your digital files.  Host a Website: AWS provides many ways to host your website in order to suit the needs of large-scale enterprises,startups, and individuals. Database Run a Database: Adds or removes virtual servers to handle peaks and lulls in traffic. Requires CloudWatch.Distributes traffic among multiple virtual servers. Deployment Deploy an Application:   AWS offers application management services that help you build, deploy, and scale applications.You can use an application management service to leverage other AWS services without having to manage each of them separately and manually. Net Work Create a Network: You can create virtual private clouds on AWS. These can be isolated from the Internet, or you can add a public-facing subnet that makes part of your network accessible from the

Differences: AWS Vs Other Cloud models

Image
The first key difference between AWS and other IT models is flexibility. Using traditional models to deliver IT solutions often requires large investments in new architectures, programming languages, and operating systems. Why AWS is Superior Although these investments are valuable, the time that it takes to adapt to new technologies can also slow down your business and prevent you from quickly responding to changing markets and opportunities. When the opportunity to innovate arises, you want to be able to move quickly and not always have to support legacy infrastructure and applications or deal with protracted procurement processes. You May Also Like: Cloud computing certification course Flexibility In contrast, the flexibility of AWS allows you to keep the programming models, languages, and operating systems that you are already using or choose others that are better suited for their project. Easy to Learn You don’t have to learn new skills. Flexibility means that

4 Key features to know in Industrial IoT

Image
The Industrial Internet is somewhat similar to the Internet of Things (IoT), sometimes even referred to as the “Industrial Internet of Things”. The general idea behind the IoT It is that many hi-tech and simple electronic devices would become interconnected with M2M (Machine-to-Machine) protocols, and therefore remotely controlled and relaying data to each other, without any manual input, or even equipped with ambient intelligence. Role of Smart Phones This idea is currently used in smart houses, and many seek wider applications. Its industrial counterpart can be viewed more from a resource and manufacturing perspective. Robots We can currently see such trends in mining, with automated trains, robotic hauling trucks, excavators, drills, and mineral processing plants, including remote fault, and malfunction control, calibration, and configuration for increased efficiency. Automation Despite the current and constant need for “on-site” human workers and operators, the t

Top Key Architecture Components in HIVE

5 architectural components present in Hadoop Hive: Shell: allows interactive queries like MySQL shell connected to a database – Also supports web and JDBC clients Driver: session handles, fetch, execute Compiler: parse, plan, optimize Execution engine: DAG of stages (M/R, HDFS, or metadata) Metastore: schema, location in HDFS, SerDe Data Mode of Hive: Tables – Typed columns (int, float, string, date, boolean) – Also, list: map (for JSON-like data) Partitions – e.g., to range-partition tables by date Buckets – Hash partitions within ranges (useful for sampling, join optimization) HIVE Meta Store Database: namespace containing a set of tables Holds table definitions (column types, physical layout) Partition data  Uses JPOX ORM for implementation; can be stored in Derby, MySQL, many other relational databases Physical Layout of HIVE Warehouse directory in HDFS – e.g., /home/hive/warehouse Tables stored in subdirectories of warehouse – Partitions, buckets

Best Skills You Need to Become an IoT Developer

Image
The Internet of things is a new subject. In this area lot of development is going on. Recently, AWS ( Amazon web services ) developed a platform for the Internet of things. I want to share with you the best skills you need to become an IoT developer. Skills You Need to Become an IoT developer This is a big Question for IT freshers or experienced IT professionals what technologies they need to learn to start a career in this line.  As a general rule, I have found the following are general requirements for the Internet of things ( See Internet of things jobs here ). Java + multiple programming languages (Objective-C, C++), and interest in technologies such as Ruby, Scala, Clojure, Groovy, etc. Experience in javascript libraries in any combination of the following areas: jQuery, AngularJS, Backbone.js, Ember.js, Node.js, GWT Development experience in open source projects, especially large scale projects a plus. Experience developing at-home projects used by a medium to large size au

2 Top Differences Automation Vs Internet of Things

Image
Five reasons why IoT automation provides opportunities to deliver better product or Services. The data from sensors is a golden asset to derive benefits and to apply in products or services. Automation and IoT both are different  Automation The automation is based on the data collected from various devices and make it happen when something goes wrong you can say as automation. The best example is based on sensor generated data the automation tool take corrective action during course of flying from one country to other.   Internet of Things More mobile phones than fixed New architecture models (ex: Cloud computing) The new protocol (Ipv6) Everything is Sensor-laden More machines than people The Growth of Internet Usage The internet will be double in size every 5.32 years. More devices can be connected to the internet through IP. The internet limitation in IPv4 is 4 billion addresses. But, the internet limitation for IPv6 is 2^128. The total IP traffic ove

How to Learn JSON XML and Simplify Your AWS Task

Image
JavaScript Object Notation (JSON) was invented by Douglas Crockford as a subset of JavaScript syntax to be a lightweight data format that is easily readable and writable by both humans and machines. In general, JSON is considered terse when compared to other interchange formats.  After you become familiar with JSON, you will find it fairly easy to read complex JSON data structures. Even though  JSON is based on a subset of the JavaScript programming language , it is considered language independent. JSON XML The flexibility of XML has made it increasingly prevalent in programming environments. Unlike the Unix® world, where configuration files are usually text files with either tab-delimited name/value pairs or colon-separated fields, configuration files in the open source world are often XML documents. Most well-known application servers also use XML-based configuration files. The Ant utility relies on XML-based files for defining tasks. Data Integration A tremendous amount of data in t

Java in Digital Applications Real Usage

Image
Recently I found, some of my friends refreshing Java language skills. I asked them why. They told me many digital applications need proficiency in Java skill. Java is the top skill, and popular in customization of all the tools involved in digital applications.  From the above conversation, I can say that at least core Java everyone should be proficient. In addition to that, Java once upon a time popular as web development language. Since Java is being used in all modern applications.  Of course, there are many other popular languages. Those are Python and Scala.   Top List of  Java Applications Robotic process automation - Daily activities in any offices can be automated with Robotic process automation. Java is the language in this scenario to write backend scripts. Artificial Intelligence -Each AI application involves some sort of programming logic. Where it validates user input and sends back output. The backend logic often is written in Java. Full stack development

6 IT skills you need to be successful in IoT (Internet of things) Career

Image
[Jobs on IoT] The following 6 skills needed to become successful in IoT career: Business Intelligence : Collect, store, & analyze smart device data streams, sensor data analysis, data center management, predictive analytics, and programming skills in leading big data platforms Information Security : Vulnerability assessment, PKI security, ethical hacking, wireless network security, data ethics, and privacy policies UI/UX Design : Ability to develop effective, user-friendly interfaces, responsive web design, and service design Mobile Development : Knowledge of mobile apps that communicate with external hardware and sensors Hardware Engineering : Develop and install Wi-Fi™, Bluetooth®, and other connectivity solutions, computer-aided design, micro-electromechanical systems engineering, wireless sensor design, and quality assurance Networking : Design, maintain, and optimize large-scale traffic across secure, reliable, and redundant backbones that connect

What is MapR? Here are Top Features to Use in Data Analytics

Image
In the following post I have given information about MapR and its popular features. The MapR’ is a San Jose, California-based organization code corporation that progresses and vends Apache Hadoop-derived code. The corporation gives to Apache Hadoop programs like HBase, Pig (programming language), Apache Hive, and Apache ZooKeeper. Apache Hadoop and Apache Spark, a distributed file system, a multi-model database management system, and event stream processing, combining analytics in real-time with operational applications. Its technology runs on both commodity hardware and public cloud computing services. MapR was picked by Amazon to supply an improved variant of Amazon’s Elastic Map Reduce (EMR) facility MapR has as well been picked by Google as a technics collaborator. MapR was capable to split the minute type pace record onto Google’s calculate program. "MapR delivers 3 adaptations of their article familiar like M3, M5 and M7. M3 is a gratis variant of the M5 arti

Dynamics of "Code Halos" in the age Digital world

Image
[IoT -Code Halos Career] “Code Halos – the information that surrounds people, organizations, and devices – are today's digital fuel. Every click, swipe, and view, every interaction and transaction generates a halo of code – a "virtual self" – that's robust, powerful, and rich with meaning and insight. You can go with an excellent book on Code halos. Code Halos are a given in our personal lives; however, they are increasingly vital to every organization's future business success.” Research conducted by Cognizant's Center for the Future of Work reveals that organizations that create, share, and distill meaning from Code Halos are dominating their industries. The dynamics of Code Halos is realized in our ever-increasing daily interactions across the web like social media, e-commerce, file sharing, smartphone apps, and other computing devices. Moreover there are multiple layers of interdependencies between each of these interactions that create a unique

How Internet of things connecting devices by 2020

Image
Code Halos in IOT According to a Cisco Internet Business Solutions Group (IBSG) study in 2011, the IoT was ‘born’ sometime between 2008 and 2009. Looking to the future, Cisco IBSG predicts there will be 25 billion devices connected to the Internet by 2015 and 50 billion by 2020. So how big is the economic impact? The Wikibon research ‘Worldwide Industrial Internet Analysis Projection, 2013’, estimates Industrial Internet technology spending at $514 billion and value delivered at $1.3 trillion by 2020. Recent IDC research cites “Explosive growth in cloud and number of Internet-connected devices is expected to propel the Internet of Things market globally to $3.04 trillion in 2020”. Related: IOT-Internet of things basics-part:1 Thus, the potential of Code Halo opportunities led by IoT is gaining unprecedented traction and is expected to drive unparalleled growth across industries. While IoT lays the foundation for Code Halos; the technology industry would undergo a sea ch

Top requirements for successful MapReduce jobs

Image
The following techniques are needed to be successful of your map reduce jobs: The mapper must be able to ingest the input and process the input record, sending forward the records that can be passed to the reduce task or to the final output directly, if no reduce step is required. Hadoop-MapReduce The reducer must be able to accept the key and value groups that passed through the mapper, and generate the final output of this MapReduce step. The job must be configured with the location and type of the input data, the mapper class to use, the number of reduce tasks required, and the reducer class and I/O types. The TaskTracker service will actually run your map and reduce tasks, and the JobTracker service will distribute the tasks and their input split to the various trackers. The cluster must be configured with the nodes that will run the TaskTrackers, and with the number of TaskTrackers to run per node. The TaskTrackers need to be configured with the JVM parameters, includ

2 Root Causes for Defects in Software Development

Image
Miscommunication Miscommunication is a common factor, which can be defined as inaccurate statements or information missing that is required for the action to be done successfully. This miscommunication ends up in the documentation or verbal communication that occurs. Instead of spending time to make sure everything is accurate, statements are made that are untrue or unclear. When this occurs at the beginning of the change process the bad information continues down through the process. Decisions and design are made based on it.  At some point it gets realized that the information is bad and a defect is created. In the common project process that could be classified as linear, most defects are not found until in the later phase of development and unit testing has started. Process Defects This would be similar to a defect a machine makes in manufacturing. Even though the input is accurate, the process itself causes a defect to occur.  The original process was prone to defects no matt

UNIX Shell script to know greatest value among three values

Image
Unix shell script program to find greatest of value. $vi prg2 ======================== clear echo "enter the value of a b c" read a read b read c if test $a -gt $b -a $a -gt $c then echo "a is greatest" else if test $b -gt $c then echo "b is greatest" else echo "c is greatest" fi fi

3 Top AWS benefits to the Organization

In this post, I have explained benefits for an organization while using AWS. You can choose the AWS as a career option since a lot of openings are there in the market. To be specific, Cloud storage is an online storage facility which is given to users so that they can use external servers to store or host their data.    Most of the business organizations need large storage capacities. Moreover, businesses need storage capacities to be clubbed with mobility. Due to this, Cloud computing has become very popular in the last few years. Amazon Web Services or AWS makes sure that anything digital is securely stored and available anywhere. Due to the same reason, Amazon Cloud computing is the most widely used and popular Cloud service on the Internet.  In this post, we will tell you about some general benefits of using Amazon Web services. We will tell you how Amazon Cloud computing helps your organization. Benefits of using Amazon Web Services Amazon Web services provide a