Category Archive for: ‘Multilingual Search’

  • – a Cut Above the Web just received yet another pat on the back from the blog Inside Science Resources. WorldWideScience a Cut above the World Wide Web – Inside Science ResourcesKhue Duong, Science Librarian at California State University, Long Beach, posted a review titled, “WorldWideScience, a Cut above the World Wide Web.” Yes, the title summarizes it well.

    Users are often surprised to learn that the engine behind is a federated search engine, bursting the myth that federated search is an antiquated, dusty bit of technology that doesn’t aggregate source results and is dreadfully slow.  Here’s the first sentence of the review:

    Are you still looking for a reliable federated search tool that goes beyond the run-of-the-mill results?

    Enter Deep Web Technologies’ next-generation federated search, Explorit Everywhere!, the powerhouse behind In the review, Khue Duong explored the search functionality (including Advanced Search) on, and performed four searches to test the application results. Three of the tests performed well, returning relevant results:

    Without displaying the additional results, searching “Isle Royale National Park” as Full Record yields 66 papers and 49 data sources. Regarding papers (document type: articles, reports, etc.), the first 40 displayed results seem to be to the point; the rest probably has some mentioning of the search term in its document. The first twenty data results has some mentioning of Isle Royale National Park in the title. The rest, such as the DNA sequences from the DNA Data Bank of Japan, shows that the sample originates from Isle Royale.

    One of the four searches didn’t yield as many relevant results.

    Note that adding an additional layer of parentheses in the search of (“isle royale national park” AND (wolf OR wolves)) also yields many misleading results in all three categories: papers, multimedia and data.

    This is hardly surprising. On public search portals like, many sources do not support title search well. Trying the above search as a full-record search brought back many good results, including the top-ranked results containing all of the search terms in the title.

    We would also like to point out that the additional search results should be displayed when the search completes as these additional results may contain some of the most relevant results available. Also displaying the additional results should significantly reduce the variability in the results returned by running the same search multiple times.

    Khue Duong, however, still recommends as a science resource for researchers:

    Overall is another one-stop-shopping platform that one should consider when searching for publications, data, and media files from governmental and international scientific domains.

    Over the last year, has garnered lots of attention as not only an excellent search portal for scientific information, but a multilingual search portal as well. In January 2015, Microsoft published a Case Study about A few months later, Deep Web Technologies published an article in magazine. And isn’t the only portal using our federated search. Explorit Everywhere! is used for several other public search portals, such as and

    We’re proud of and proud to support the DOE Office of Scientific and Technical Information (OSTI) in bringing this free, publicly available, multilingual search portal to science and technology researchers around the world.

  • INIS Sees Impressive Searches Through

    The International Nuclear Information System, INIS, operated by the International Atomic EnergyAgency (IAEA) in Vienna, Austria, INIS cooperation with the   IAEA INIShouses the INIS Collection which offers access to over 3.6 million bibliographic records and over 350,000 full-text documents on topics such as Radioactive Waste Management, Nuclear Safety and the Fukushima and Chernobyl accidents. This set of non-conventional literature is available directly through the INIS online search, and is also included in the federated search portal.  

    The portal, governed by the WorldWideScience Alliance, is a global gateway to scientific databases and portals. The portal accelerates information discovery through a one-stop search of databases around the world, including the INIS Collection.

    Cooperation between the International Nuclear Information System (INIS) and WWS dates back to June 2009 when the first contacts were made during the Summer Public Conference, Managing Data for Science, organized by the International Council for Scientific and Technical Information (ICSTI) in Ottawa, Canada. Following the conference, a WWS Alliance meeting was organized where inclusion of the INIS database as a new information resource into the WWS was discussed.

    In 2012, was the top referrer to the INIS Collection, with search numbers predicted to grow.

    Current statistics of searches coming to the INIS Collection Search from WWS are impressive. There were almost 70 000 unique searches during the first 7 months of 2015 and this number is constantly increasing. The first 7 months of 2015 alone generated the same amount of searches as the whole of 2014. By the end of 2015, the number of searches coming from WWS to INIS is expected to reach 100 000.

    Deep Web Technologies proudly provides the federated search technology that powers the portal. In June, DWT upgraded the portal to include a mobile, responsive design and localization of page text. Other small improvements ensure that WorldWideScience will continue to advance information discovery for its researchers and Alliance members.

  • DWT Partners with Microsoft Translator

    We are now a Microsoft Translator Alliance Partner. DWT was invited to join the brand new WWS-FlowMicrosoft Translator Partner program which is designed to create opportunities for businesses to deliver best-in-class translation solutions.

    DWT uses the Microsoft Translator API to create multilingual search solutions for global customers. These solutions tap into the available Microsoft Translator languages and automatic translation capability so researchers can query multilingual databases in their own language, and then translate results from the sources back into their query language. Behind the scenes, DWT and Microsoft Translator shift the query from the user’s language into the language of the information sources, search the sources for the most relevant results, retrieve, aggregate and rank the results, and then translate the results back into the user’s selected language. It’s a seamless, powerful process that melts walls between researchers of different languages by allowing information discovery and flow without the need for personal translators.

    This unique, multilingual search feature originally launched with in 2010. is a global science gateway comprised of national and international scientific databases and portals. With the DWT-Microsoft Translator partnership, users can search in ten different languages and translate results from sources in multiple languages back into their selected search language.

    In early 2015, Microsoft sponsored a “Customer Story” page entitled WorldWideScience Alliance and Deep Web Technologies, revealing the history, technology and benefits of the multilingual solution. In April, DWT followed the customer story with a guest article in Multilingual Magazine, expanding on the nature of multilingual applications, the development and benefits of multilingual searching for government agencies and global companies.

    Deep Web Technologies’ is the technology behind other notable public multilingual search portals such as and UNECA’s Each of these custom portals uses DWT’s Explorit Everywhere! federated search technology and the Microsoft Translator API to search and translate.

    DWT’s partnership with Microsoft Translator is vital to the steady pulse of our multilingual applications. We believe that each multilingual application we build furthers the cross-pollination of global ideas and scientific advancement. Share our vision: In the not-too-distant-future, language barriers for science researchers and global business searchers no longer exists, and informed research will access critical information in multilingual databases with one search.

  • 2015 Enhancements has received a tremendous amount of press so far in 2015. On January 8th, Microsoft published a case study on and Deep Web Technologies:

    “ is the result of years of research and innovation. Although the underlying technology itself is exciting, case-studyDeep Web Technologies and the WorldWideScience Alliance are most interested in what it enables for users. “This solution increases access to worldwide information, which is the biggest benefit,” explains Johnson. “We search approximately 100 repositories that we estimate include more than 500 million pages of science and technology information. So instead of having to go to 100 different sources to find content, using Microsoft Translator offers the ability to search all of them with a single query.”

    Then, the April/May issue of Magazine published an article entitled, “Advancing Science by Overcoming Language Barriers.” The article discussed the rise of and its role in bridging language barriers using Microsoft’s machine translation.

    In late June, Deep Web Technologies updated, just in time for the WorldWideScience Alliance meeting in Germany. Responsive design is now an integral part of the application making it much easier to add new features now and in the future. The spotlight enhancements include:

    1. Mobility: is now mobile and can now be accessed from any device. When a user goes to the application on a mobile device, the interface will automatically adjust to their screen size, making it easier to search and view results.
    2. Localization: While has been a multilingual application for years, allowing users to translate results into their language of choice, now, when a user chooses English, Spanish, French or Portuguese, will automatically update the interface text to the selected language too.

    There are a host of other small improvements to This upgrade is setting the stage for future enhancements such as MyLibrary, the ability to save results for future reference, and additional language localizations. Take a look from your smartphone or tablet and let us know what you think! isn’t the only application recently updated. received a facelift recently as well.

  • Check Out Our Article in Magazine

    The April/May 2015 issue of Magazine features a new article, “Advancing science by overcoming language barriers,” co-authored by DWT’s own Abe Lederman, and Darcy Katzman.   The article discusses the Deep Web vs. the dark web, and the technology needed to find results in scientific and technical, multilingual Deep Web databases.   It also speaks of the efforts of the WorldWideScience Alliance in addressing the global need for a multilingual search through the creation of the federated search application.MultiLingual 2015 Apr May

    Think of the Deep Web as more academic — used by knowledge workers, librarians and corporate researchers to access the latest scientific and technical reports, gather competitive intelligence or gain insights from the latest government data published. Most of this information is hidden simply because it has not been “surfaced” to the general public through Google or Bing spiders, or is not available globally because of language barriers. If a publication reaches Google Scholar, chances are, it now floats in the broad net of the shallow web, no longer submerged in the Deep Web. A large number of global science publications are located in the Deep Web, only accessible through passwords, subscriptions and only accessible to native language speakers. These publications, hiding in the Deep Web, limit the spread of science and discovery.

    The current issue of Magazine is free to view at the time of this post.

  • Microsoft Case Study – Bridging the Gap Between Language and Science

    On January 8, 2015, Microsoft published a new, Customer Solution Case Study about Deep Web Technologies’ innovative search technology developed in collaboration with the WorldWideScience Alliance.  Using the Microsoft Translation services, the search application allows users to search in their native language, find results from sources around the world, and read the results translated back into their language. In light of the enormous strides made each year in the global scientific community where timely dissemination of the vast published knowledge is critical, increases access to many important databases and encourages international collaboration.

    The WorldWideScience Alliance turned to Abe Lederman, Chief Executive Officer and Chief Technology Officer of Deep Web Technologies, to realize its vision of a better, more automated solution with multilingual support. “We wanted to create an application that would make scholarly material more accessible worldwide to both English and non-English speakers,” he says. “For instance, we wanted a French-speaking user to be able to type in a query and find documents written in any language.”

    The Case Study, posted to the Microsoft “Customer Stories” page, comes on the heels of a update in 2014, improving the application look and feel and speed. Additionally, 2015 holds a bright future as the study mentions: “To provide better accessibility, also offers a mobile interface. Deep Web Technologies is launching a streamlined HTML5 version that will work with virtually any device, whether PC, phone, or tablet. Other future enhancements include a localization feature that will provide search portals in the user’s native language.”

    In response to the Case Study, Olivier Fontana, Director of Product Marketing for Microsoft Translator said, “Microsoft Translator can help customers better reach their internal and external stakeholders across languages.  By building on the proven, customizable and scalable Translator API, Deep Web Technologies has developed a solution that has a direct impact on researcher’s ability to learn and exchange with their peers around the world, thereby improving their own research impact.” The Microsoft Translator Team Blog has followed up on the Case Study here.

    Oh, and one more thing… is not the only Deep Web Technologies’ multilingual application. WorldWideEnergy translates energy related content into four languages and the United Nations Economic Commission for Africa will be rolling out a multilingual search in 2015.

    Read DWT’s Press Release

  • Hello – Goodbye ETDE

    In June of 2014, the Energy Technology Data Exchange (ETDE) ended.  It must have been a sad day for the Office of Scientific and Technical Information (OSTI), having nurtured ETDE from a fledgling search site over 27 years ago to a venerable collection of over 5 million literature citations and over 90 participating countries.

    But OSTI recognizes a good thing when they have one.  ETDE hasn’t disappeared completely, but fused into a bigger, stronger, application – – with a robust search by Deep Web Technologies.  Perhaps the song “Hello, Goodbye” by the Beatles should be playing in the background here – Hello, Hello, Goodbye, Goodbye, ETDE.

    Aside from the new look, boasts a truly foreign object: Multilingual support.  Users can enter their query term in not only English, but Spanish, German and Swedish.  On the results page, translate the results into your language.  Talk about making it simple!Translate the results to Swedish!

    Aside from the fueling the discovery of citations from participating countries, OSTI expects this feature to attract additional countries to the WWE Consortium, helping their content become more discoverable.  The future is brilliant…thermonuclear perhaps.


  • A 2014 Makeover lets users search for science around the world in a matter of seconds.  First deployed in 2008, this transformational technology unearths content that under normal circumstances would remain only available to users searching a database specifically.  And if that’s not enough, scientists and researchers can search in their own language for cutting-edge information from other countries and have it translated back into their own language.  Of course, uses the Explorit Everywhere! Multilingual search feature by Deep Web Technologies.

    Now, after 6 years of fabulous press and high useage, OSTI has decided to shake things up.  They are making BETTER.  Eh?  How’s that, you say?

    I feel blue…
    When an organization able to make a bright purple look authoritative says it’s time to make a World Wide Science   Main View   Search Results for Full Text  climate changechange, we listen. now sports a progressive, modern look reflective of the digital age. It’s an impressive new look and feel.

    My country tis of thee…
    For researchers looking for results from a specific country, or to explore and discover results by country, we have good news! now has a country cluster, grouping results from specific countries for easier viewing.

    Hello, Salut, Hola and Hallo
    Using our new Explorit Everywhere! Multilingual architecture, the updated language search and translation of is faster and more thorough than before.  Users simply select their query language from the 10 language options and search!

    The folks at OSTI have more up their sleeve, so don’t be surprised if you hear more good news in the coming months!


  • The End of an Era Comes to OSTI

    Dr. Walter Warnick, Director of the U.S. Department of Energy Office of Scientific and Technical Information (OSTI), is retiring in early January 2014 after 17 years as Director. Dr. Warnick embraced the idea of knowledge dissemination, and championed aggressive efforts to capitalize on technological advances such as federated search.   Abe Lederman, DWT’s President and CTO is attending a retirement celebration today at OSTI in Oak Ridge, Tennessee. Abe’s remarks on his years working with Dr. Warnick are below.

    I recall vividly my first meeting with Dr. Warnick, Walt to me, in his office in Germantown in 1999. A few months back we had launched our first Explorit application at OSTI, the Environmental Science Network and were working on our second OSTI Dr. Walter Warnickapplication – Energy Files.

    This meeting in Germantown was the start of a very close friendship between Walt and I that continues to this day and I’m sure will continue long into the future. In the last 15 years or so Walt and I have had several thousand phone conversations and email exchanges. In many of these exchanges Walt would challenge me to push the limits of what federated search could do. Today in great part to Walt’s persistence and support we have set the gold standard for what federated search can do.

    In May 2004, Deep Web Technologies, was a small 2 and 1/3 person company that I was running out of my home office. We were working on a DOE Phase I grant and had just submitted a Phase II grant proposal. Not wanting to leave anything to chance Walt orchestrated an impressive launch of 2.0 at DOE Headquarters and managed to get Ray Orbach, then Director of the Office of Science and Spencer Abraham, then Secretary of Energy to attend the event. Having the Secretary of Energy credit the DOE SBIR program for major enhancements to didn’t hurt and we got our Phase II grant. Deep Web Technologies is now a 20 person company with over 100 customers worldwide. A lot of our success is due to the support that we’ve received through our partnership with Walt and OSTI.

    Through and other OSTI portals, Walt was always focused on making more and more content available to as he called them, the “science attentive citizen” and helping to accelerate scientific progress. Walt has been a visionary and a very uncommon Federal Government executive. He always challenged his staff, was always willing to take risks and was never patient with things that took too long to accomplish.

    The science portal that I am most proud of having developed is, a portal that now searches over 100 of the best science portals from all over the world, including databases in multiple languages. WorldWideScience got its start as a collaboration between the DOE Office of Science under Ray Orbach and the British Library now under Madame Lynn Brindley. I recall fondly attending a number of major events for in London, Seoul and Helsinki. Walt managed to establish a close relationship with Tony Hey, a senior Vice President at Microsoft who has become a strong supporter of OSTI.

    Walt has promoted WorldWideScience globally. At the highest levels of the State Department WorldWideScience is used as an example of scientific collaboration between the U.S. and the Chinese and Russian governments. In a presentation to the U.N. in Geneva in 2011 Walt spoke about how WorldWideScience had become an important resource to help bridge the digital divide between countries that have access to the latest scientific information and those that don’t.

    Three years ago I wrote a post for my company’s blog, Reminiscing on a 12 year partnership with OSTI, inspired by a wonderful article that Walt had written – Federated Search as a Transformational Technology Enabling Knowledge Discovery: The Role of In that blog post I had promised to highlight a few of the accomplishments of our partnership with OSTI in my next blog post. Although a bit late I now have the content for that follow-on blog article and promise to post this talk to our blog tomorrow.

    Walt, best of luck with whatever you do next. I’m sure that you will continue to promote the causes that are dear to you exemplified in the OSTI Corollary – Accelerating the sharing of scientific knowledge accelerates scientific discovery.


  • DWT Search Portal Instead of a Book? Why Not?

    While many schools of thought might consider this notion preposterous verging on sacrilegious, David Wojick suggests that (WWS) just happens to be THAT good.  In his interview on Scholarly Kitchen’s Chefs’ Selections:  The Best Books Read During 2013 (Part 2) he states:

    WWS integrates almost a hundred other science portals, most of which are national in scope, while some are international. The chief US contribution is, itself a federated portal which integrates numerous US federal agency research report portals. Both WWS and were built and are operated by the Department of Energy’s Office of Scientific Information (OSTI). Deep Web Technologies is the amazing developer.

    With a multilingual translation feature for results, WWS has captured scientists from across the globe. While Kindle may not support WorldWideScience for a bedtime story, the WWS mobile app can rock you softly to sleep in 10 different languages.  And no need for a bookmark.