- Open Access
Building an R&D chemical registration system
© Martin et al.; licensee BioMed Central Ltd. 2012
- Received: 13 February 2012
- Accepted: 11 May 2012
- Published: 31 May 2012
Small molecule chemistry is of central importance to a number of R&D companies in diverse areas such as the pharmaceutical, nutraceutical, food flavoring, and cosmeceutical industries. In order to store and manage thousands of chemical compounds in such an environment, we have built a state-of-the-art master chemical database with unique structure identifiers. Here, we present the concept and methodology we used to build the system that we call the Unique Compound Database (UCD). In the UCD, each molecule is registered only once (uniqueness), structures with alternative representations are entered in a uniform way (normalization), and the chemical structure drawings are recognizable to chemists and to a cartridge. In brief, structural molecules are entered as neutral entities which can be associated with a salt. The salts are listed in a dictionary and bound to the molecule with the appropriate stoichiometric coefficient in an entity called “substance”. The substances are associated with batches. Once a molecule is registered, some properties (e.g., ADMET prediction, IUPAC name, chemical properties) are calculated automatically. The UCD has both automated and manual data controls. Moreover, the UCD concept enables the management of user errors in the structure entry by reassigning or archiving the batches. It also allows updating of the records to include newly discovered properties of individual structures. As our research spans a wide variety of scientific fields, the database enables registration of mixtures of compounds, enantiomers, tautomers, and compounds with unknown stereochemistries.
- Chemical registration system
- Chemical database
- Chemical cartridge
- Molecule import
Small molecule chemistry is of central importance to a number of R&D companies in diverse areas, such as the pharmaceutical, nutraceutical, food flavoring, and cosmeceutical industries. These institutions all face similar problems, such as how to register and store information regarding small molecules in their corporate collections. The registration of compounds becomes even more complicated when two or more compounds have to be registered together as a mixture that has a particular mixture-specific property. Generally, people working on such projects have to find answers to the same questions, namely, which technology to use, what type of data need to be stored, how to manage physical samples of molecules, how to define the uniqueness of chemical structures, and how to make sure that the chemical structures entered by the chemists are drawn correctly. Surprisingly, this topic is rarely covered by scientific publications, and few insights can be gained from chemoinformatics books [1–5]. This is partly because it is a very technical challenge that is met by developers of the registration systems and partly because it is a rapidly evolving field.
In this paper we show how a chemical registration system can be built that we call the Unique Compound Database (UCD) and implemented at the corporate level of companies working with chemicals. Some elements of this system have been presented at two congresses [6–8]. Here, we provide examples from our experience of building a chemical registration system at Philip Morris International, Inc. (PMI).
Quality of chemistry representation
Examples of chemical cartridges
Name; web source
Available for free
Accelrys Direct; http://www.accelrys.com/products/informatics
Accelrys Accord; http://www.accelrys.com/products/informatics
CambridgeSoft Oracle Cartridge; http://www.cambridgesoft.com/solutions/details/?fid=186
ChemAxon JChem; http://www.chemaxon.com/jchem/intro
IDBS Activity Base; http://www.idbs.com/products-and-services/ activitybase-suite
GGA Software Services Bingo; http://ggasoftware.com/opensource/bingo
Oracle and SQL Server
MolSoft MolCart; http://www.molsoft.com/molcart.html
Pgchem tigress; http://pgfoundry.org/projects/pgchem
Challenge of registering diverse data
The source of chemical compounds to be stored in a chemical registration system depends greatly on the business of the company. For instance, in pharmaceutical companies, compounds are synthesized internally or purchased from external suppliers and can represent millions of individually identified chemical structures. In the flavor and fragrance industry, compounds are often natural products extracted from plants.
For the tobacco industry in general, and for PMI R&D in particular, chemical constituent sources are relatively limited in comparison with traditional pharmaceutical inventories. Approximately 8400 compounds have been identified from tobacco plants and tobacco smoke . However, we made sure that our system is as universal as possible and can hold millions of compounds as well. The challenge posed by the implementation of a registration system in this context is not the number of compounds to be registered, but rather the wide range of different chemistries represented (peptides, natural products, sugars, and complex products resulting from tobacco combustion). As such, a critical step in the project was to identify what we need to register and how to ensure that the quality criteria were met effectively.
Design of the UCD
Our intention was to build a registration system of the compounds we use, not to create an inventory; therefore, the physical location and quantity of the chemical compounds were not considered. A project team of three chemoinformaticians supported by a project manager was responsible for defining needs and user requirements. Most of the requirements were related to chemical structure representation and storage; the starting point was that it must be possible to create and modify structures in the platform and to record physical samples attached to their related compounds.
For the purpose of data uniformity and uniqueness, the chemoinformaticians specified that the structures entered in the system have to be standardized prior to registration, and that uniqueness should be defined at the level of neutral molecules. In consequence, when a new batch is submitted, if a duplicate of the corresponding compound is found in the database, the system must create a new batch for the compound. It is also important for users to have the possibility to register compounds for which structures are not known. Such cases are annotated as “No Structure”, meaning that no particular chemical structure is defined. This is useful, for example, for analytical chemists working with mass spectrometry who might encounter the same peak in several gas chromatography and liquid chromatography mass spectra, without being able to identify the compound. For salts, the neutral form of the molecule is drawn and associated with the appropriate counter ions and ratio. In the same manner, hydrates are not drawn, but are associated with the chemical structure. The system must, therefore, be able to verify the uniqueness of the molecule regardless of whether it is in the form of a salt or a hydrate. The canonical representation is generated for each structure by the system, and the different tautomers of the same molecule must have the same canonical representation.
A temporary staging area (submission area) was planned to enable the storage of new molecule entries until they are validated by an expert before final registration in the system. In addition, three options were created to search by chemical structure: exact search, substructure search, and similarity search.
It was also important to define how batches should be managed by the person in charge of validating the data entered in the system. Batch reassignment was defined as an important feature of the system; batches can be reassigned from one molecule to another molecule by the registrar. This functionality also had to be available for the batch assigned to a molecule with « no structure«, for when the structure of the molecule is finally identified. To ensure that no information is lost during the process, an audit trail of the modification must be kept. In the same way, it should be possible for the person in charge of the system to archive batches, but not to delete them.
Technical requirements to make the system compatible with our technical infrastructure were also defined. For example the system should be compatible with Oracle 11 g , Windows Server 2003 , VMware ESXi  and Citrix . In terms of performance, the system should be able to support 300 users through a centralized architecture, but five queries at the same time were considered the maximum. It was also imperative that data be available to external tools, and for this purpose a direct database access was requested in order to implement Extract Transform Load (ETL) processes .
The result of this process was a document containing 147 user requirements describing the platform.
Data organization: Concept of molecule, substance, and batch
Molecule: a neutral form of the chemical structure without any charge, counter-ion, or hydrate. If a molecule is charged, the system changes it to its neutral equivalent and records its salt form at the substance level. An exception was made for substances containing quaternary ammonium cations. The particularity of the quaternary ammonium cations is that they are permanently charged, independent of the pH of their solution. In this case, the system does not neutralize the molecule.
Substance: a molecule (neutral or charged) with its counter-ion or hydrate.
Batch: an occurrence of the compound in the company, generally a physical sample, identified from mass spectrometry, or a reference in the relevant literature.
Each level requires specific information that is either entered manually by the scientists during the submission step of the registration or calculated automatically by the system. For example, the information related to the project, scientist, laboratory notebook reference, and analytical results is stored at the batch level (manual entry). Information related to the chemical substance, i.e., IUPAC name, codes (InChI and SMILES), and physicochemical properties such as molecular weight and logP, is stored at the substance level. Analogically, the same kind of information is stored at the molecule level for the neutral chemical structure.
The IUPAC names, SMILES, and InChI codes generated by the UCD can be canonical and/or can only partly represent the stereochemistry. When a molecule contains more than one group of relative stereocenters the chemical line notations SMILES and InChI are not sufficient to correctly represent the stereochemistry. For example, the ‘either’ bond (wavy line) pointed to a stereocenter cannot be encoded in InChI or SMILES codes. To represent the stereochemistry as precisely as possible we used the Symyx enhanced stereochemistry labeling (see section Use of enhanced stereochemistry). For such cases registered in the UCD, it is the detailed 2D drawing of the structure with enhanced labeling that assures the uniqueness of the molecule. In order to omit the ambiguity and be sure we are working with a single unique structure, the UCD generates a unique UCD code.
In the UCD, SMILES and InChI are still generated because these popular chemical line notations are useful to do some queries in external databases and the unique UCD code is an internal company code. However, it should be noted that considerable progress to guarantee uniqueness of the structural description using line notations has been made, as it can be seen in two recent publications [16, 17], introducing and discussing yaInChI and CTISMILES codes, respectively.
In addition, the UCD allows the registration of mixtures of enantiomers. Because mixtures of the same enantiomers in different ratios (e.g., 50:50 and 30:70) may have different physico-chemical properties, the UCD generates a unique code for each ratio. Importantly, even if different enantiomers or mixture of enantiomers of the same molecule have different UCD codes, a search using the structure of the molecule will retrieve all the entries.
Dealing with chemical structure
The core technical functionality of the registration system is to handle chemical structures. Basically, this means that each chemical structure must be stored as a unique representation, and that the drawing of the structure must include all structural information, such as stereochemistry, so that users have the possibility to search by exact structure, substructure, or similarity.
Although it is possible to generate unique codes and do searches using classical chemoinformatics tools such as Pipeline Pilot  or Chemistry Development Kit , we believe the most suitable approach is to use a chemical cartridge as the central core of the registration system. Chemical cartridges have the advantage of offering very good performance (for the search of compound), because chemical structures are indexed in the database. In order to match our design and concept of the UCD, we chose the Accelrys Direct (formerly Symyx Direct) chemical cartridge (see in Table 1).
Use of enhanced stereochemistry
One of the main difficulties with chemical registration systems is the representation of uncertainties of stereoconfigurations and mixtures of stereoisomers. A common challenge in chemical structure registration is to represent stereogenic centers precisely, even when the absolute configuration is not known. We solved this issue by using a leading system of stereo centers description, i.e., Accelrys enhanced stereochemical representation (V3000 format), which uses embedded labels in the structure to allow precise configuration of the molecule for each possibility.
Rules for drawing molecules
Standardization and validation of compound representation
In addition, once a molecule is in the registration area, we can manage the potential user errors in the structure entry by reassigning or archiving the batches. The system also allows the records to be updated to include newly discovered properties of individual structures. This batch reassignment process will be explained in section Batch reassignment.
Validation of data registered in the chemical registration system is imperative to ensure the reliability of the content. In our case, the two staging areas allow scientists to be part of the registration process and the registrar to check discrepancies and errors. However, because we decided that not all scientists should be able to create new records, we defined three roles.
Authentication to access the database is managed by Lightweight Directory Access Protocol (LDAP) accounts with three groups corresponding to the three roles. Depending on the group that the user belongs to, different permissions can be assigned (Figure 10).
· The role of Viewer includes all R&D users that have access to the UCD. Viewers can search and view registered data via a web interface (except for some “restricted fields” reserved for specific teams).
· The role of Submitter is reserved for scientists who create new information. Submitters have the same privileges as Viewers, but can also access to a submission form to insert new records in the database.
· The role of Registrar is restricted to chemoinformaticians. Registrars have the same privileges as Submitters, but are also responsible for checking and validating data in the submission area (source, project ID, etc.) and giving approval for registering an entry.
A batch can be reassigned to a different substance if the user realizes that the structure was entered incorrectly or determines stereogenic centers during later experiments. If a substance no longer has a batch, the substance is archived as inactive. If after this process a molecule no longer has a substance, the molecule is archived. There is no ‘delete’ process; all new entries are assigned chronologically with new codes. This procedure allows for correction of errors without losing any information related to the archiving process.
In a chemical database, it is suitable to have names and certain properties (such as ADMET) calculated automatically. Even though our system generates corporate compound IDs (UCD codes) upon the registration of each entry, it is important that chemical names and other identifiers, such as IUPAC names or CAS numbers, be recorded to provide links to molecules in external databases. ACD/Labs Name Batch tool is used to automatically and accurately generate most names according to guidelines of the IUPAC from the molecular structure. However, naming structures with enhanced stereochemistry is an issue: see example of (2R,4 S)-4-chloropentan-2-ol in Figure 3 for which IUPAC names with such detailed description of stereochemistry cannot be generated. The software Accelrys Pipeline Pilot is used to predict ADMET properties and to calculate lead-like and Lipinski indicators. ACD/Labs PhysChem is used to automatically calculate water solubility values for the molecules.
Implementation of the platform
It is known that the implementation of chemical registration systems can be a lengthy and difficult process. It was critical from the start that the project be clearly delivered in the shortest timeframe possible and that the implementation team be built to ensure maximum efficiency. As mentioned previously, a team was put together of three chemoinformaticians, one project manager, and the support from the former Symyx consulting team. This team was empowered by management to make all decisions regarding the chemical representation and standardization rules, the data structure, and the technical implementation strategy. A production system was available four months after the initial kick-off meeting.
The number of submitters is limited in our company, but many people were interested to consult the data. We wanted a more flexible solution for the people who are only interested in viewing the data. We then chose to develop a web interface using Oracle Application Express 4.1 (Apex) to visualize the data in the UCD. Apex is a tool integrated by default in Oracle 11 g and dedicated to build web interfaces for Oracle databases in a very efficient way. The web interface is available to a large number of users in our company.
Once the UCD was ready, a critical step was the migration of all the existing data. As is often the case, our scientists had the names of the molecules and some information about them stored locally in diverse file formats such as Excel or text (e.g., CAS number, experimental molecular weight, origin of the compound). The following section describes the challenges involved in transforming names into structures and enabling automatic import of molecules into the UCD.
Transformation of names into structures
In building the UCD without any existing infrastructure, we had two major sources of compounds available: 1) names of molecules as listed in the literature and 2) internal working compounds, which are often referred to by their IUPAC names, common names (e.g., harmane), or CAS numbers.
Of the 7372 molecule names entered, 70% of the structures were generated correctly; 7% of the structures were generated with warning messages, which required manual curation; and 23% of the structures were not generated because the names were not recognized by the software (Figure 14). For this subset of molecules there was no easy or automatic way to obtain a structure; therefore, the chemists had to check and correct each name and its structure manually. To obtain a structure for these molecules, we conducted searches in PubChem , ChemSpider , and Google . For some molecules, an associated CAS number was available, which allowed us to obtain the structure using SciFinder® , a tool for exploring the CAS databases. Clearly, during the construction of our UCD, structure conversion took considerable time (in terms of months for one chemoinformatician) and the effort and time required should not be underestimated.
Automated migration workflow
This protocol requires an input file in SDF (stands for structure-data file) format. In this input file the structure of the molecules is described by a Connection Table in V3000 format (as explained in section Use of enhanced stereochemistry). The SDF format was chosen because of its ability to include associated data. The input file contains information about the molecule structure and all the data associated with this molecule (e.g., Project name, internal identifier, scientist who works on this compound).
In order to ensure that structures are normalized according to the same rules as defined for the manual import, we developed a Java component for Pipeline Pilot which uses the Java API of Accelrys Cheshire to normalize chemical structures.
At PMI R&D, we have built a chemical registration system called the Unique Compound Database (UCD), which manages the registration process in an efficient and non-redundant manner in a very short timeframe.
In order to register data efficiently and accurately, the UCD has the flexibility to register molecules with unknown structures or mixtures of compounds and at the same time can be used to register known structures with the precisely defined stereochemical configuration. This level of detail ensures the uniqueness of chemical records. Pre-defined standardization rules, drawing rules, automated normalization, and enhanced stereochemistry labeling decrease the chance of erroneous or ambiguous registry. Moreover, the system decreases the name-to-structure ambiguity by using only drawn structures (with the enhanced stereochemistry when known) and by generating names only after the registration process is completed.
The reliability of the database and the accuracy of the registration process are enhanced by the two-stage area. The Submitter or bench chemist takes ownership of the records and registers the records “from the bench”. This process is assisted by the automated standardization rules and automatic structure check. The Registrar reviews the submitted molecules and validates the structures before registration. The two-stage area system also allows the Registrar to detect potential software issues that the Submitter might have encountered.
Concerning the molecule-to-salt and salt-to-batch associations, our model prefers registering molecules as neutral entities, where predefined salts are listed in a dictionary and selected by the user at the substance level. Salts are standardized and do not have to be drawn. Batches are then assigned to the substance entry. We believe this process provides a higher level of molecule description and easier traceability of different entries. Furthermore, batches can be re-assigned or archived, thus providing the company a way to deal with new changes to the structures (i.e., structure elucidation) and to log such changes. We have also observed that actual data import into the newly built platform is the time-consuming and the most challenging step.
Finally, we believe that the UCD concept is an efficient and progressive way to accurately register and describe all structures at the corporate level. The database is modular and flexible. It allows us to link the accurately described molecules to other databases. Thus, uniqueness of molecular description in the UCD provides the robust foundation of the company chemical space. In consequence, compounds can be moved to complex knowledge bases and data can be mined for biological activities, modes of action, and therapeutic outcomes.
Future development of the UCD platform will include linking with the integration of spectroscopic information in relationship with the different entities stored in the system. We are also planning to move the entire system to a web-based architecture using the latest in sketcher technologies, which will increase the ability of the bench scientist to easily register any new substance. In addition, we will be integrating the chemical standardization rules within the database itself to simplify the maintenance process.
The authors express their gratitude to Peter Hliva for developing a Java component for Pipeline Pilot which uses the Java API of Accelrys Cheshire and to Lynda Conroy for editing the manuscript.
- Chemical Structure Information Systems: Interfaces, Communication, and Standards. 1989, ACS Symposium Series 400. Washington, DC: American Chemical SocietyGoogle Scholar
- Buntrock RE: Chemical registries–in the fourth decade of service. J Chem Inf Comput Sci. 2001, 41: 259-263. 10.1021/ci000109q.View ArticleGoogle Scholar
- Gobbi A, Funeriu S, Ioannou J, Wang J, Lee M-L, Palmer C, Bamford B, Hewitt R: Process-driven information management system at a biotech company: concept and implementation. J Chem Inf Comput Sci. 2004, 44: 964-975. 10.1021/ci034269o.View ArticleGoogle Scholar
- O'Donnell TJ: Design and use of relational databases in chemistry. 2009, CRC Press, Boca Raton, London, New YorkGoogle Scholar
- Weisgerber DW: Chemical abstracts service chemical registry system: history, scope, and impacts. J Am Soc Inf Sci. 1997, 48: 349-360. 10.1002/(SICI)1097-4571(199704)48:4<349::AID-ASI8>3.0.CO;2-W.View ArticleGoogle Scholar
- Martin E, Monge A, Duret J, Pospisil P: Building an R&D chemical registration system. In Ninth International Conference on Chemical Structures (ICCS). 2011, Poster P-13, Noordwijkerhout, June 5–9Google Scholar
- Martin E, Monge A, Duret J, Peitsch M, Pospisil P: Building an R&D chemical registration system. In 43rd IUPAC World Chemistry Congress: July 31-August 5. 2011, TPC200-Poster Session I, San JuanGoogle Scholar
- Martin E, Duret J, Monge A, Knorr A, Stueber M, Stratmann A, Arndt D, Peitsch M, Pospisil P: Building a corporate R&D chemical registration system that links structures to analytical spectra and biological activities. In 43rd IUPAC World Chemistry Congress: July 31-August 5. 2011, IAC102-General Oral Session III, San JuanGoogle Scholar
- Accelrys Web-page. [http://accelrys.com/],
- Rodgman A, Perfetti TA: The chemical components of tobacco and tobacco smoke. 2008, CRC Press, Boca Raton, London, New YorkGoogle Scholar
- Oracle. [http://www.oracle.com/],
- Microsoft Windows Server . [http://www.microsoft.com/windowsserver],
- VMware. [http://www.vmware.com/],
- Citrix. [http://citrix.com/],
- Extract Transform Load. [http://www.etltool.com/what-is-etl.htm],
- Cho YS, No KT, Cho KH: yaInChI: Modified InChI string scheme for line notation of chemical structures. SAR QSAR Environ Res. 2012, 23: 237-255. 10.1080/1062936X.2012.657677.View ArticleGoogle Scholar
- Gobbi A, Lee M-L: Handling of Tautomerism and Stereochemistry in Compound Registration. J Chem Inf Model. 2011, 52: 285-292.View ArticleGoogle Scholar
- Chemistry Development Kit . [http://sourceforge.net/projects/cdk/],
- McMurry J: Essentials of general, organic, and biological chemistry. 1989, Prentice Hall, Englewood Cliffs, NJGoogle Scholar
- Haworth projection. [http://goldbook.iupac.org/H02749.html],
- Advanced Chemistry Development, Inc., Toronto, ON, Canada . [http://acdlabs.com/],
- PubChem. [http://pubchem.ncbi.nlm.nih.gov/],
- ChemSpider. [http://www.chemspider.com/],
- Google. [http://www.google.com/],
- SciFinder® . [https://scifinder.cas.org],
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.