Originally posted by Intel
View Post
- Visitors can check out the Forum FAQ by clicking this link. You have to register before you can post: click the REGISTER link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. View our Forum Privacy Policy.
- Want to receive the latest contracting news and advice straight to your inbox? Sign up to the ContractorUK newsletter here. Every sign up will also be entered into a draw to WIN £100 Amazon vouchers!
Big Data
Collapse
X
-
-
I have around 100TB of Porn stashed on the cloud across various providers. Does that constitute Big data?Comment
-
Originally posted by FatLazyContractor View PostI have around 100TB of Porn stashed on the cloud across various providers. Does that constitute Big data?Comment
-
Originally posted by DimPrawn View PostI don't think you get it. Luckily a lot of people do ;-)
Analysing unstructured data like tweets and Facebook posts maybe one area of Big Data but I've done that before using sql server as it had to be connected to the companies structured data e.g. there may be 'likes' about a certain product and this data needs joining. And the number of tweets per organisation is vastly smaller.
IBM's definition includes voracity too, so unstructured isn't the only thing.
Either way I don't believe that the vast majority of companies need big data solutions.Comment
-
Originally posted by GB9 View PostI'm not sure they do.
Analysing unstructured data like tweets and Facebook posts maybe one area of Big Data but I've done that before using sql server as it had to be connected to the companies structured data e.g. there may be 'likes' about a certain product and this data needs joining. And the number of tweets per organisation is vastly smaller.
IBM's definition includes voracity too, so unstructured isn't the only thing.
Either way I don't believe that the vast majority of companies need big data solutions.
E.g. analyse every cell phone conversation on the planet. Speech recognition in every known language, and then looks for trends in terms of military threats.
Look for patterns, predict likely probabilities. In real time.Comment
-
Analyse particle accelerator collisions to look for unusual interactions.
Big Data Vital to CERN Large Hadron Collider Project, Says CTO
For example, proton and anti-proton collisions at the recently closed Tevatron accelerator at Fermilab generated an estimated 100 MB of data per second since its opening in 1967 - and that data volume represents only 100 Hz of a 1.7 MHz collision due to the limited bandwidth the data was able to be captured.Comment
-
Originally posted by DimPrawn View PostI don't think anyone here has done big data, if they had they would realise no DB on the planet could do it. It's unstructured unrelated txt and data to be analysed in vast quantity and then apply predictive analytics to cluster, predict and gain insights.
It's not my DB is 3TB in size, I'm doing big data.
When I look back at the number of truly tulipe database instances that I have bumped into over the last decade its pretty obvious that schema design and old school data analysis is almost extinct so taking a tulip schema and trying to pump whatever is inside it into a data pond is never going to end well...Comment
-
Anyway, it's the Predictive Analytics that gives the value.
Clustering such as K-means, dimensionality reduction (PCA anyone?) and regression that provides the value. Anyone doing PCA using SQL Server? What about Bayes inference of future trends?
Anyone?Comment
-
unless you can identify the businesses key drivers and understand what is needed to be done to affect these drivers then all big data does is hide the answers you need amongst lots of other data.
Also you can come up with a huge amount of incorrect corollaries because data seems to have some sort of link but it does not.Comment
-
Originally posted by original PM View Postunless you can identify the businesses key drivers and understand what is needed to be done to affect these drivers then all big data does is hide the answers you need amongst lots of other data.
Also you can come up with a huge amount of incorrect corollaries because data seems to have some sort of link but it does not.
Big Data is such a terrible name, whoever coined it needs shooting. It's data science that's big not the data size...Comment
- Home
- News & Features
- First Timers
- IR35 / S660 / BN66
- Employee Benefit Trusts
- Agency Workers Regulations
- MSC Legislation
- Limited Companies
- Dividends
- Umbrella Company
- VAT / Flat Rate VAT
- Job News & Guides
- Money News & Guides
- Guide to Contracts
- Successful Contracting
- Contracting Overseas
- Contractor Calculators
- MVL
- Contractor Expenses
Advertisers
Contractor Services
CUK News
- Streamline Your Retirement with iSIPP: A Solution for Contractor Pensions Sep 1 09:13
- Making the most of pension lump sums: overview for contractors Sep 1 08:36
- Umbrella company tribunal cases are opening up; are your wages subject to unlawful deductions, too? Aug 31 08:38
- Contractors, relabelling 'labour' as 'services' to appear 'fully contracted out' won't dupe IR35 inspectors Aug 31 08:30
- How often does HMRC check tax returns? Aug 30 08:27
- Work-life balance as an IT contractor: 5 top tips from a tech recruiter Aug 30 08:20
- Autumn Statement 2023 tipped to prioritise mental health, in a boost for UK workplaces Aug 29 08:33
- Final reminder for contractors to respond to the umbrella consultation (closing today) Aug 29 08:09
- Top 5 most in demand cyber security contract roles Aug 25 08:38
- Changes to the right to request flexible working are incoming, but how will contractors be affected? Aug 24 08:25
Comment