Designed a scalable distributed architecture for Inktomi's next-generation crawling and content acquisition service. The service can be run on a single machine, or it can dynamically balance load across a cluster of servers. It is optimized for working with datasets at least one order of magnitude larger than available core memory. As a single crawl over all documents can take several hours/days, it is designed to gracefully fail and recover from service interruptions.

As a member of a small team working on the crawling framework, I am implementing the database code for managing URLs and associated meta data. I am writing a String-B-Tree (a modern variant of the B-Tree algorithm using Patricia-Tries for efficiently storing variable length keys) to accomodate the specific requirements of the crawling service.

Worked with product management on designing and implementing web-based tools for competitive analyses, and focus group evaluation of new search engines. Wrote a full competitive analysis of Inktomi's existing and upcoming products in comparision to a major competitor.

As part of Resonate's next-generation management infrastructure, designed and implemented the first two public releases of the CD Adapter middle-ware server. Used CORBA to publish an self-describing, extensible, and object oriented interface to all legacy protocols.Trained other team members to use, interface with, and maintain different parts of the code.

Implemented generic library functions for reliable management of distributed objects, unified error handling in highly multi-threaded environments, simplified thread manipulations, and common I/O processing hiding the different proprietary communication protocols.

Maintained software components for monitoring services, kernel-level IP load-balancing modules, encrypted password management, Swing based GUI code, and internationalization support. Provided development environments and script files for other team members and other organizational groups; using Java, C, Perl, Bourne Shell, or Makefiles.

Designed and implemented browser based software deployment framework for one-click installation, upgrading, and launching of arbitrary native applications. Wrote generic user authentication framework in Java with support for pluggable back-ends. Used RMI for the client-server communication. Implemented user authentication on top of any ODBC enabled database. Maintained middle-tier server software.

Implemented fully automated cross-platform build environment for ClearCase, Java, C, InstallShield for Windows, and pkgadd for Solaris. Implemented and deployed encrypted license management system. Responsible for final packaging on CD-ROM of all releases. Administered ClearCase source control system. Trained other employees in the use and administration of UNIX servers. Introduced and maintained Linux and FreeBSD for use as internal servers.

Developed device-independent BOOT-Prom for diskless PC's booting into DOS, Windows, and Linux implementing embedded BOOTP/DHCP, TFTP, NFS, and a UDP/IP network stack using C and x86 glue code. Commercially ported additional device drivers for use with the BOOT-Prom: http://www.etherboot.org.

Donated Linux sound-support to XEmacs: http://www.xemacs.org

As an independent contractor, designed and implemented communication protocols between Smalltalk and C applications on OS/2, and legacy applications on MVS. Implemented multi-threaded server for managing persistent data. Used OS/2 IPC and SNA as the networking protocols. Evaluated and recommended third-party development products. Evaluated third-party knowledge workbench products and AI languages. http://www.provinzial-online.de