SKA news

[AtW]

Just finished a major update to SKA taking it to v0.1.2.

A lot more pages indexed, and tricky part of getting incoming links text taken into account is now done

You can give it a spin here. Note that the server does other things so first response might be slow: I figured out how to scale SKA to build index with 100s of millions of web pages in them, but now need to tune actual search module to scale well without slow search.

Managed to find Contractor UK site in it

May Allah punish the infidels :rolleyes

[BobHope2]

I like the way it makes you guess whether it died or didn't return any output for

"contractor uk fiddleabout"


keeps you guessing eh?

[Lucifer Box]

Not Bad

It seemed fast enough to me - virtually instant.

How much more work do you reckon is needed?

[MarillionFan]

Re: Not Bad

"How much more work do you reckon is needed? "

Well until you add in the ability to search for relevant information then its pretty much bloody useless. Ie. Its fact, it obviously works but as I am using by test search as

Dr Who Viewing Figures
and
"Dr Who" "Viewing figures"

I should receive different answers but I dont, and neither one is relevant to what I was searching for.

ATW check the syntax with Google and try to place an algorithm for relevance, then by Jove I think the boy will have it.

[SupremeSpod]

Re: Not Bad

AtW, I'm working with a nice Russian young lady here in Jerusalem, she speaks very little English but apparently her Hebrew is top notch!

Spod - In "Which is nice" mode!

[planetit]

Re: Not Bad

I don’t get it. All the results seem to be this site, or your own sites.

[Maximus]

Connection time out for me!!!!

[DimPrawn]

Relevance

AtW,

Your search engine is plenty fast enough. What it lacks is relvance.

An example. Search for Kimberly Tripp (not a porn star I'm afraid) who is No.1 at MS working on SQL Server 2005.

Google returns a whole bunch of results all related to SQL Server on the 1st page:

Kimberly L. Tripp: Improving your SQL skills
Kimberly L. Tripp: Improving your SQL skills. Saturday, 25 June 2005. 8 Steps to
better Transaction Log throughput. On a few of my last trips, ...
www.sqlskills.com/blogs/kimberly/ - 101k - 25 Jun 2005 - Cached - Similar pages

SQLskills.com | Immerse Yourself In SQL Server
... consulting, mentoring and custom Immersion events focused on Microsoft SQL
Server. SQLskills was founded by SQL Server Specialist Kimberly L. Tripp.
www.sqlskills.com/ - 31k - 25 Jun 2005 - Cached - Similar pages

.NET Rocks! hosted by MSDN
Download, Kimberly Tripp on SQL Server 2005 (#110) Kimberly Tripp talks about
her famous USB Key demonstration of SQL Server 2005 partitioning and provides ...
msdn.microsoft.com/dotnetrocks/ - 39k - 25 Jun 2005 - Cached - Similar pages

Kimberly Tripp on .NET Rocks! this week
re: Kimberly Tripp on .NET Rocks! this week 8/3/2004 9:03 PM Samboy Lims. This is
an absolutely great, great episode! I must say even the 2 hours seemed not ...
pdcbloggers.net/Community/NET_Rocks/3791.item - 17k - 26 Jun 2005 - Cached - Similar pages

Kimberly Tripp takes the lead with an 8.80 score!
DAT351, The Clustered Index Debate Kimberly L. Tripp, 8.77, 84. 5. MSG308,
Securing Access to Exchange Server from the Internet Using ISA Steve Riley, 8.77 ...
geekswithblogs.net/dsmith/archive/2004/05/27/5483.aspx - 13k - Cached - Similar pages

Aaron Weiker Weblog - Kimberly Tripp get's the SQL CLR and tries ...
Kimberly Tripp get's the SQL CLR and tries to explain it to us.
www.sqlskills.com/blogs/k...4b96-973c- ...
www.aaronweiker.com/ PermaLink,guid,5dd3112f-99fb-446a-a464-5a67884ff377.aspx - 23k - Cached - Similar pages

adam machanic :: data manipulation for fun and profit : Kimberly ...
Kimberly Tripp on SQL CLR: "Microsoft has put in the work to give the DBA control
over this technology." Widely acknowledged SQL Server expert Kimberly ...
www.sqljunkies.com/WebLog/ amachanic/archive/2005/04/04/10287.aspx - 31k - Cached - Similar pages

Robert Hurlbut's SQL Server Blog : Kimberly Tripp on .NET Rocks
Kimberly Tripp on .NET Rocks. Kimberly Tripp, SQL Server guru and MVP, was
on .NET Rocks last week. The show is available for download here. ...
www.sqljunkies.com/WebLog/ rhurlbut/archive/2004/08/02/3724.aspx - 20k - Cached - Similar pages

.net thinking - Pre-Con : Kimberly Tripp on Taming the SQL Server ...
Pre-Con : Kimberly Tripp on Taming the SQL Server 2005 Tools. This afternoon I
had the pleasure of attending Kimberly Tripp's pre-conference session on ...
iceglue.com/tranqy/ PreConKimberlyTrippOnTamingTheSQLServer2005Tools.a spx - 13k - 26 Jun 2005 - Cached - Similar pages

Kimberly Tripp on SQL Server 2005
Kimberly Tripp talks about her famous USB Key demonstration of SQL Server 2005
partitioning and ... Kimberly Tripp on SQL Server 2005 (04/27/2005 05:02 pm) ...
www.ntcompatible.com/Kimberly_ Tripp_on_SQL_Server_2005_s46091.html - 46k - Cached - Similar pages


Now do the same thing in your search engine:

Genealogy Depot
...arriage nash Browne Browning Betsy Betty Brunger Bryam Bryan Bryant Buck Bucking... ...nia Leander Lelia Louisiana Lucinda Lidy Lois Linda Letitia Loisa Lorna Lori Lei...
www.genealogydepot.com/ - 71k - Text (Rank: 0)


Moyle
...ie Hazel Moyle b: April 4, 1895 in Tripp, Hutchinson County, South Dakota d: Jan... ... Edward Moyle b: March 19, 1897 in Tripp, Hutchinson County, South Dakota d: Jul... ..., Missouri .................. 5 Kimberly Sue Oliver b: October 5, 1960 in Kansas...
hood.hctc.com/~emoyle/moyle.htm - 27k - Text (Rank: 0)


Bubster.org
Links Friends: Tripp's Website Kimberly's Divinity Aaron's Deviant Art Funny
www.bubster.org/links.htm - 1k - Text (Rank: 0)


Clemens Vasters: Enterprise Development & Alien Abductions - The SQL Goddess Blogs
...Blogs You read it here first. Kimberly Tripp rss). If you do anything with SQL Serve...
staff.newtelligence.net/clemensv/PermaLink.aspx?guid=cc228a09-d9f2-4629-8f58-97025aca1366 - 65k - Text (Rank: 0)


Mun's Place - where Mun talks about stuff
...ipp: Improv... Lamont Harrington's Blog Langleyben Leon Larkware News Larry Osterman's WebLog...
www.munsplace.com/blogger/ - 45k - Text (Rank: 0)


Chicago PDCA Directory
...4 North Tripp Avenue Chicago, IL 60641 773/736-0010 773/736-1798 FAX Jef... ...imberly Touchstone 4211 Wildwood Drive Crystal Lake, IL 60014 815/477-95... ...4 North Tripp Avenue Chicago, IL 60641 773/736-0010 773/736-1798 FAX R, C...
www.chicagopdca.org/pdcadirectorycss.htm - 84k - Text (Rank: 0)


PlånetSocks.com - Serving Your Online Needs for Two Millennia
...$15 nonbillabletime $15 Backpack $15 asparaguspee $15 mskity $15 Kimbe... ... playahater $10 NaNaBaby $10 jkmcgoo $10 blowsfan $10 Linda Tripp $6.66 ... ...Our Benefactors: UnrepenantSinner $250 MissyB $150 MadWoman $150 Anonymo...
www.planetsocks.com/ - 101k - Text (Rank: 0)


Connecticut Lawyer
...h Kimi Kimmy Kimo Kin Kimberley Kimberly Kimble Kimbra Kimbro Killdaire Killian ... ...n Kadeem Kaden Kadesh Kadesh-barnea Kadi Kacie Kacy Kadar Kade Kadee Kachada Kac...
www.connecticut-lawyer-ct.com/ - 107k - Text (Rank: 0)


RRCA Challenge Ten Miler 2002, Columbia, MD
...g the course. Dick George and Dave Tripp ran the finish line, and Jim DiScuillo ... ...4 Howard Co Striders 1:02:35.04 43 Tripp, Jason M:29 Howard Co Striders 1:02:38.... ...ntgomery Co RRC 1:23:58.05 268 St. Clair, Christy F:53 Baltimore RRC 1:24:01.77 ...
www.striders.net/races/rrca/rrca02.htm - 61k - Text (Rank: 0)


Buying Partners: Distributors of Toner and Office Products to the World
...NGTON KENSINGTON SPORT KIDDE KIMBERLY-CLARK KODAK KODAK POLYCHROME GRAPHICS... ...INDUSTRIES TOMBOW TOPS TOSHIBA TRIPP LITE TROY SYSTEMS INTERNATIONAL, INC. ...
www.buyingpartners.com/ - 27k - Text (Rank: 0)



Completely irrelevant stuff. Like a set of random sites. Not good I'm afraid and i've tried a lot of other searches and there seems to be no relevance to the results. :rolleyes

[DimPrawn]

Re: Relevance

Another example.

Enter Swindon College.

and get:

University College Chester: Postgraduate Prosepctus 2005
...and its Facilities Who to Contact Fees and Funding Whether you intend to stu... ...ts. The College provides all full-time students with a Council Tax Certificate, which may exem...
www.chester.ac.uk/postgraduate/2005/fees.html - 26k - Text (Rank: 277)


Hartpury College - Veterinary Nursing > Full Story
...ns to register with the Royal College of Veterinary Surgeons (RCVS): 5 GCSEs at ... ...y Nursing by attending college one day a week over two years or through block re... ...ay a week in college. After the BVNA ANA has been obtained, you will be able to ...
www.hartpury.ac.uk/news/detail.asp?PRID=394 - 25k - Text (Rank: 277)


manchester community college Free Research Information.
...esults for: manchester community college You searched for manchester community college : Showing Results 1 - 20 Featured Sites 1. manchester community college in the Free Online EncyclopediaRead abo...
http://www.askjack.co.uk/search/manc...y%20%20college - 52k - Text (Rank: 277)


On the 1st page, when there are clearly thousands of sites more related in some way to Swindon College than those sites. You only have to compare the results with other search engines to see that your search engine lacks rules to understand what is a relevant site and what is clearly not.

Focus on this aspect AtW.

[fiddleabout]

Re: Relevance

I suspect that the reason may not lie in the code...

SKA... Searching 11,358,826 web pages
Google... Searching 8,058,044,651 web pages

Google has the minor advantage of having 700 times as many pages to chose from. The chances are that none of the first few hundred google hits are even indexed by the SKA.

Perhaps when AtW has indexed the 658,239,861 pages crawled by the SKA in it's first 6 months of life it will do better but even then google will have more than 10 times as many.