Pages

Showing posts with label Analytics. Show all posts
Showing posts with label Analytics. Show all posts

2016-10-04

Is Analytics a Noun or a Verb?

English: The syntax tree of noun phrase "...
English: The syntax tree of noun phrase "my neighbour's daughter-in-law" with layered determiner analysis. (Photo credit: Wikipedia)
Is Analytics the name of your department, or do you actually "do" Analytics?

Doing analytics requires you to look at your data, apply some logic, and make or support making a decision with the data.


For many years I have built and maintained analytical platforms. These platforms had the core of a Business Intelligence architecture with some one-offs for the occasional "sophisticated" analysis as needed. I was not specifically doing analytics during this time. I knew many of the tools and techniques that were being applied. At times, I was even the one writing the SQL queries to pull the data together to load into SAS for statistical modeling. However, I rarely took it so far as to actually do the Analytics myself. That was not my role.

Now I am in a position where I am the one doing the Analytics, and I see and recognize the impedance mismatch that occurs when I use the term analytics, versus when some people use the same term.


Data Analytics is a very overloaded term in today's environment.  Yet as sophisticated as we may be in evolving from our ancestors simple things still make a big difference.


Using incredibly simple definitions:
A Noun is a person, place or thing.

A Verb is an action, or state of being.


Analytics can be a noun. "I am in charge of the Analytics department!"

Analytics can also be a verb. "I applied Analytics to the data until it gave me the answer!"

Analysis, or analytical thinking is a way of learning from and understanding the data that we have available to us in order to solve a specific problem or answer a specific question.

I think how this word evolved to be a noun is that there have been times where people with analytical skills(verb) were gathered together in one place. In order to have a question answered you had to go to the Analytics department (now it is a noun - place.)

As this place evolved, the people doing the analysis needed support, programmers, managers, project managers, special coders,etc.

Now you can say you work in Analytics and mean the department. This carries some clout with it, because it sounds as if you have the skills and capabilities of those doing the analysis.

Not necessarily. You may learn some valuable things, and through the natural sequence of apprenticeship you may be able to be the one "doing analytics" at some point.

To me, Analytics is a Verb, and it should only be a verb. Using it in any other context is a disservice to the word.






2016-01-20

Data Will Work if it flows

How does data actually do work?


Data does work in a similar manner to water.

Water left alone can do very little.

Cleansed water can rejuvenate a tired body.

Channeled water can turn wheels to create energy for  transforming raw materials into usable materials.

Transforming water into steam can turn mighty turbines to create energy for a myriad of purposes depending on the enterprises goals.

 

 Cleansing

Clean drinking water...not self-evident for ev...Image via Wikipedia

Water must be cleansed in order to be consumed. Impurities from the environment can contaminate the water making it unsuitable for a particular use.

Just as water needs to be cleansed before it can be used for a particular purpose, so to must data be cleansed to ensure that its usefulness can be guaranteed.

Data Cleansing is the act of detecting and correcting (or removing) corrupt or inaccurate records from a record set, table, or database. Used mainly in databases, the term refers to identifying incomplete, incorrect, inaccurate, irrelevant etc. parts of the data and then replacing, modifying or deleting this dirty data.

For all data there is a standard of use. Is the data useful the way it was entered into the data capture system for the function that we are trying to perform? For example, do we need to look up any codes or convert timestamps from one timezone to another? If the data meets this standard, then it does not need cleansing. If it does not meet this standard then it does need cleansing. The standard of use is either explicit with rules around the processing of the data or implicit the data is simply accepted as it was entered.


Channeling

Schematic diagram of an overshot water wheel.Image via Wikipedia
When a large body of water is channeled through a small channel the force of the volume of water moving through the channel moves obstacles out of the way.

When you take Big Data, and mine through the data to find a particular use case you are channeling the data to focus on a particular problem.








Transforming

English: Ice Sculpture, Natural History Museum...
English: Ice Sculpture, Natural History Museum, London SW7 The lighting brings the ice sculpture to life. (Photo credit: Wikipedia)

When water is heated it becomes steam. When frozen it becomes ice.
Ice structures can be amazingly beautiful when created by the right artist.


Today's Enterprises, whether they be great or small, are all but ships on the great ocean of information. Each piece of data we encounter is as a drop in that ocean.

How do you make data work for you?


I originally wrote this article before the concept of a Data Lake became popular. As I am cleaning out my drafts as part of my challenge, I found this draft.

The concept of Data Lake, just like a man made reservoir, is to store the data until such time as you know you will need to use it. Proper Data Management best practices should be applied to the Data Lake, and when you need to understand a particular business question use some of the tools at your disposal, hopefully ones you have built, to filter the "water" in your data lake to answer your question.

By the way cleansing, transforming, and channeling is just another way to say use a Lambda function to apply to all of your data to get the answers you need.

And if you want to understand all of the "tributaries" coming into and leaving your Data Lake, might I suggest a Data Structure Graph? Keeping track of all of the data flows through an organization will become a tedious task if not done right from the beginning.

It's not magic.

Just follow best practices.


Enhanced by Zemanta