[Go to Search page]

D'ni Sphider

If you're reading this page, then you've probably seen entries in your server access logs with the user agent "D'niSphider".

The D'ni Sphider Project

D'ni Sphider is a search engine aimed to catalogue websites and individual webpages related to the Myst™ and Uru™ computer games from Cyan Worlds Inc., and other relevant articles of potential direct interest to fans of those games.

Generally, these will be fan sites or official sites associated with the games but may include more general sites where, e.g. an interview with one of the key developers has been published. In the latter case, D'ni Sphider will incorporate only the material of direct relevance, rather than the entire site.

D'ni Sphider is based on the open source Sphider light weight search engine. It is an experimental project and may be discontinued at any time.

The Dnisphider Bot

D'niSphider is the website indexing agent for D'ni Sphider, a search engine aimed to catalogue websites and individual webpages related to the Myst™ and Uru™ computer games from Cyan Worlds Inc., and other relevant articles of potential direct interest to fans of those games.

The bot obeys all recognized robots.txt rules as well as NOINDEX or NOFOLLOW meta keywords. It will endeavour to "play nice" with your website and not overload it with requests. You may see dnispider make several visits over a period of a few days while it indexes your webpages (depending on the size of your site) but once indexed it should not visit again for several weeks.