Originally posted by GB9
View Post
- Visitors can check out the Forum FAQ by clicking this link. You have to register before you can post: click the REGISTER link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. View our Forum Privacy Policy.
- Want to receive the latest contracting news and advice straight to your inbox? Sign up to the ContractorUK newsletter here. Every sign up will also be entered into a draw to WIN £100 Amazon vouchers!
Big Data
Collapse
X
-
-
The key difference with Big Data™ is that it tries to relate unstructured/semi structured data, not replace well organised relational data.
If your data is very good and structured, it can go into a traditional RDMS and then into a data warehouse.
If your data is a billion word documents, you can't stick them in a RDMS and get any insight into them.
A good example is analyzing all the company emails, tweets about the companies products, internet articles and blog posts to identify sentiment and trends.Last edited by DimPrawn; 4 May 2016, 10:02.Comment
-
I run a predictive analytics team and as part of a launch of an internal tool last month the Sales EVP told our 2000 sales for that a new Big Data sales tool using Predictive Analytics would be used to drive our cross sell and upsell opportunities.
We actually did it in a SQL database and analysed the data in Excel to produce a model. Less than one million records.
The hard part was getting the bloody data in the first place as all the sources were cloud.
It's marketing bollocks.What happens in General, stays in General.You know what they say about assumptions!Comment
-
Atw is doing big data, probably without realising it.
Crawling the Internet for unstructured data and analysing to summarise, catagorise, give insight into its meaning and relationships.Comment
-
It's marketing tulip force fed to CIOs so they have something to one-up their mates on the golf course on a weekend.
BI is a journey, most of my clients barely have any idea of how to collate, analyse and monetise their internal data assets before looking at external and BD assets.
Build the foundations, then the walls etc. Trying to start with the roof is pretty difficult....
On the upside it's keeping me in gigs knocking together Enterprise Data Warehouses after the teams implementing it realise they have no idea about the quality and accuracy of their data....Have you tried switching it off and back on again??Comment
-
Originally posted by Intel View PostIt's marketing tulip force fed to CIOs so they have something to one-up their mates on the golf course on a weekend.
BI is a journey, most of my clients barely have any idea of how to collate, analyse and monetise their internal data assets before looking at external and BD assets.
Build the foundations, then the walls etc. Trying to start with the roof is pretty difficult....
On the upside it's keeping me in gigs knocking together Enterprise Data Warehouses after the teams implementing it realise they have no idea about the quality and accuracy of their data....
Big data is analysing something like every tweet in realtime and obtaining understanding of how the World sees your products.
BTW there's 9100 tweets per second to analyse, 24/7/365. Try that in your SQL server DB.Comment
-
Originally posted by DimPrawn View PostThat's not big data. That's analysing structured data in a DW.
Big data is analysing something like every tweet in realtime and obtaining understanding of how the World sees your products.
BTW there's 9100 tweets per second to analyse, 24/7/365. Try that in your SQL server DB.
Yep I understand the difference between structured and big data. I was referring to the journey you have to go on in order to effectively utilise big data to drive revenue opportunities in a business. If you don't have the structured data and analysis capabilities in place first trying to use big data is like putting the cart before the horse. How do you measure the impact of your use of BD if you don't have a handle on your internal data assets?Have you tried switching it off and back on again??Comment
-
I don't think anyone here has done big data, if they had they would realise no DB on the planet could do it. It's unstructured unrelated txt and data to be analysed in vast quantity and then apply predictive analytics to cluster, predict and gain insights.
It's not my DB is 3TB in size, I'm doing big data.Comment
-
Originally posted by Intel View PostYep I understand the difference between structured and big data. I was referring to the journey you have to go on in order to effectively utilise big data to drive revenue opportunities in a business. If you don't have the structured data and analysis capabilities in place first trying to use big data is like putting the cart before the horse. How do you measure the impact of your use of BD if you don't have a handle on your internal data assets?
SA100 for individuals paying Income Tax
SA800 for partnerships
SA900 for trusts and estates of deceased persons
CT600 for companies paying Corporation Tax
P35 for PAYE deductions by employers and National Insurance contributions
VAT100 for value added tax
Then drive insights on likely errors, tax dodgers, fraud etc.
Not that they are doing that, ahem,Comment
-
Originally posted by DimPrawn View PostGovt might want to analyse every tax return ever submitted, each year the fields and structure are different. Would be a big task for a RDBMS to handle the vagueness and the textual aspects.
SA100 for individuals paying Income Tax
SA800 for partnerships
SA900 for trusts and estates of deceased persons
CT600 for companies paying Corporation Tax
P35 for PAYE deductions by employers and National Insurance contributions
VAT100 for value added tax
Then drive insights on likely errors, tax dodgers, fraud etc.
Not that they are doing that, ahem,
and under that is a structured database of tax payers. With details of how much tax they've paid every year, that they can then use to analyse the impact of the use of the big data solution. i.e. Are the actions taken effective or not?
Take away that tax payer database and you're left with a lot of analysis about data assets you don't have a handle on.
Oh, wait a minute......Have you tried switching it off and back on again??Comment
- Home
- News & Features
- First Timers
- IR35 / S660 / BN66
- Employee Benefit Trusts
- Agency Workers Regulations
- MSC Legislation
- Limited Companies
- Dividends
- Umbrella Company
- VAT / Flat Rate VAT
- Job News & Guides
- Money News & Guides
- Guide to Contracts
- Successful Contracting
- Contracting Overseas
- Contractor Calculators
- MVL
- Contractor Expenses
Advertisers
Contractor Services
CUK News
- Streamline Your Retirement with iSIPP: A Solution for Contractor Pensions Sep 1 09:13
- Making the most of pension lump sums: overview for contractors Sep 1 08:36
- Umbrella company tribunal cases are opening up; are your wages subject to unlawful deductions, too? Aug 31 08:38
- Contractors, relabelling 'labour' as 'services' to appear 'fully contracted out' won't dupe IR35 inspectors Aug 31 08:30
- How often does HMRC check tax returns? Aug 30 08:27
- Work-life balance as an IT contractor: 5 top tips from a tech recruiter Aug 30 08:20
- Autumn Statement 2023 tipped to prioritise mental health, in a boost for UK workplaces Aug 29 08:33
- Final reminder for contractors to respond to the umbrella consultation (closing today) Aug 29 08:09
- Top 5 most in demand cyber security contract roles Aug 25 08:38
- Changes to the right to request flexible working are incoming, but how will contractors be affected? Aug 24 08:25
Comment