 Research
 Open access
 Published:
Finding the K best synthesis plans
Journal of Cheminformatics volumeÂ 10, ArticleÂ number:Â 19 (2018)
Abstract
In synthesis planning, the goal is to synthesize a target molecule from available starting materials, possibly optimizing costs such as price or environmental impact of the process. Current algorithmic approaches to synthesis planning are usually based on selecting a bond set and finding a single good plan among those induced by it. We demonstrate that synthesis planning can be phrased as a combinatorial optimization problem on hypergraphs by modeling individual synthesis plans as directed hyperpaths embedded in a hypergraph of reactions (HoR) representing the chemistry of interest. As a consequence, a polynomial time algorithm to find the K shortest hyperpaths can be used to compute the K best synthesis plans for a given target molecule. Having K good plans to choose from has many benefits: it makes the synthesis planning process much more robust when in later stages adding further chemical detail, it allows one to combine several notions of cost, and it provides a way to deal with imprecise yield estimates. A bond set gives rise to a HoR in a natural way. However, our modeling is not restricted to bond set based approachesâ€”any set of known reactions and starting materials can be used to define a HoR. We also discuss classical quality measures for synthesis plans, such as overall yield and convergency, and demonstrate that convergency has a builtin inconsistency which could render its use in synthesis planning questionable. Decalin is used as an illustrative example of the use and implications of our results.
Introduction
Synthesis planning is a core problem in chemistry, first treated as computational problem by CoreyÂ [1] in the late sixties. The objective is to find a way to synthesize a given target molecule from available starting materials, possibly optimizing costs such as amount of materials, price, or environmental impact of the process.
Synthesis planning is still regarded as somewhat of an art form, although attempts have been made over several decades at applying formal approaches and computational methodsÂ [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15]. Such attempts have focused on models of synthesis plans, quality measures for ranking such plans, and algorithms for finding the best plan among several possible plans.
An early contribution towards an automated approach for synthesis planning is retrosynthetic analysis. It was introduced by CoreyÂ [1, 12, 13] in 1969 as part of a formalization of the rules of synthesis used in the development of the computer program LHASA (logic and heuristics applied to synthetic analysis). Retrosynthetic analysis is a topdown approach to synthesis planning, which governs the selection of the chemical bonds to be involved in the synthesis by using heuristics formulated to mimic a chemistâ€™s reasoning. The basic idea is simple: Starting with the target chemical structure, split the molecule by removing a bond indicated by the heuristic. Then recursively continue on the generated smaller molecules until sufficiently simple or commercially available starting materials have been found. As an alternative to using heuristics trying to mimic the choices of chemists, BertzÂ [6, 10] suggested choosing bonds by minimizing the graph theoretical molecular complexity of the resulting precursor molecules. Other approaches include choosing bonds based on the existence of substructures of the target molecule that are isomorphic to easily accessible or available molecules found in librariesÂ [16,17,18,19]. An overview of programs for synthesis planning based on retrosynthesis can be found inÂ [3, 14].
A major drawback of retrosynthesis, however, is that it is a greedy approach. In the attempt to make good choices during the retrosynthetic topdown recursion, it leaves out synthesis plans with costly last steps but much better first steps. Consequently, plans found using a retrosynthetic approach are not necessarily optimal plans according to quality measures for synthesis plans.
Contribution
The starting point of this paper is the observation that computing a single good plan does not always suffice: Models of synthesis plans and definitions of quality measures necessarily leave out many realworld details, and the best plan according to a given choice of model and quality measure may turn out to be infeasible when later adding further chemical details to the plan. A more robust strategy would be to instead find a number of good plans from which the practitioner can choose based on additional chemical knowledge and wetlab feasibility. We believe that such a strategy can significantly increase the practical value of formal synthesis planning. Generating and evaluating all possible plans is a natural approach, but this is highly inefficient due to the combinatorial explosion in the number of plans. In this paper, we make the strategy feasible by providing an efficient method for finding the K best synthesis plans, for any number K.
Our approach is based on representing the set of chemical reactions under interest as a directed hypergraph (a known method in chemistry, see e.g.Â [9]). We demonstrate that synthesis plans correspond exactly to the concept of hyperpaths^{Footnote 1} in such hypergraphs. This in turn allows us to exploit an existing polynomial time algorithmÂ [20] for finding the K shortest hyperpaths in a hypergraphâ€”to our knowledge the first use of this algorithm in a chemical context. The result is a big improvement in the computational complexity of ranked enumeration of synthesis plans, which is our core contribution.
Besides adding robustness to synthesis planning, the strategy also enables an easy way to find plans that are optimized according to more than one quality measure: compute a set of the best plans for each measure and output their intersection. Similarly, one can use intersections of sets of good plans for several values of yield estimates, in order to obtain plans stable against variance in the actual yields obtained. Another feature of our approach is that it is not restricted to using a socalled bond set (many existing methods in formal synthesis planning are based on bond sets), but it has larger flexibility in terms of modeling the set of reactions available.
Along the way, we also demonstrate that one of the known classical quality measures surprisingly has a builtin inconsistency which could render its use in synthesis planning questionable.
The rest of this paper is structured as follows: In the â€śPrevious workâ€ť section, we list the existing research closest to our contribution. In the â€śSynthesis planning basicsâ€ť section, we outline relevant synthesis planning concepts. In the â€śResultsâ€ť section, we point out problems that can arise when using unarybinary trees for modeling synthesis plans, and demonstrate how to solve these problems by the use of directed acyclic graphs and hypergraphs. We define a structure called a hypergraph of reactions, which we prove contains all synthesis plans as hyperpaths (TheoremÂ 1). We then show how this allows us to find theÂ K best synthesis plans in polynomial time (TheoremÂ 2). We also discuss quality measures. In the â€śDiscussionâ€ť section, we put our approach in a practical context using the molecule decalin as an example, before ending with "Conclusions" section.
Previous work
The previous line of work closest to the work in this paper is by HendricksonÂ [8] and by SmithÂ [9]. They both focus on graph based descriptions of synthesis plans, and on formal quality measures of these plans. HendricksonÂ [8] models synthesis plans as binary trees, and defines quality measures based on convergencyÂ [21], which essentially is how balanced the tree is. The rationale for this quality measure is that the more balanced the tree for a plan is, the fewer reactions the average starting material will take part in, either directly or as part of larger molecules in later reactions. All reactions incur some loss, and the strategy aims at reducing this loss. SmithÂ [9] models synthesis plans as hypergraphs, and defines quality measures more explicitly based on the actual loss incurred by each reaction. In both papers, the focus is on finding a single best plan according to the quality measure in question. Smith explicitly gives an algorithm based on dynamic programming for finding this in his setting.
In terms of programs for synthesis planning, Hendricksonâ€™s line of work has led to a program SynGen (synthetic generator)Â [15]. This program retrosynthetically expands all possible ways to synthesize the carbon skeleton of the target molecule, offering different ways to assist selection of plans after they have been computed. As the program enumerates all plans, it is computationally costly even for synthesis plans of depth threeÂ [15].
Our work in this paper can be said to extend the methods of Smith and Hendrickson. In combination with an algorithm from [20], we are able to find the K best synthesis plans for a target without having to compute all plans, resulting in a much better computational efficiency.
A concept somewhat related to synthesis planning is finding pathways in metabolic networks, see e.g.Â [22] for a recent review. The work most closely related to ours isÂ [23], which models metabolic pathways as a type of hyperpaths and gives a method for enumerating pathways between a set of source compounds and a target compound in the network. However, their algorithm enumerates all pathways, not theÂ K best according to a quality measure. Other papers reviewed inÂ [22] do consider finding pathways in ranked order, but the modeling there is as simple paths in standard graphs.
Synthesis planning basics
A synthesis plan describes a way to synthesize a given target molecule from available starting materials by a set of chemical reactions. There are two main types of reactionsÂ [8]: construction reactions, which create new carbonâ€“carbon bonds in the targetâ€™s skeleton, and functionalization reactions, which alter the functional groups attached to the skeleton but do not alter the skeleton itself. Synthesis planning often proceeds in two phases, the first of which is identification of a set of construction reactions, and the second is consideration of functionalization reactions. The rationale for using such a two phase procedure (from fewer to more chemical features) during the search for an optimal synthesis plan is that the full chemical design space is too vast to explore efficiently. Usually, the first phase is considered to be the core of the planningâ€”to quote HoffmannÂ [7, p.Â 5], â€śThe points stressed earlier should be highlighted once more: Construction of the skeleton of the target structure is the prime task in synthesis planning, not the placement of functionalities or stereogenic centersâ€ť. Following most of the work on formal methods for synthesis planning, we therefore focus on the first phase and model construction reactions only.
Construction reactions come in two variants: affixations which add target bonds by uniting two separate precursor molecules, and cyclizations which add target bonds by closing a ring in a single molecule. Construction reactions are often said to fix a bond in the target, and the set of bonds fixed in the plan is denoted the bond set.
The usual way to depict such synthesis plans is using unarybinary trees, where affixations give rise to binary vertices and cyclizations to unary vertices. Leaves represent starting materials, internal vertices represent intermediate molecules, and the root represents the target molecule. Some example plans for the target molecule decahydronaphtalene (IUPAC name Bicyclo(4.4.0)decane) are depicted in Fig.Â 1. This compound, with the trade name decalin^{Â®}, is a bicyclic organic molecule with ten carbon atoms. It is an important industrial solvent for resins, waxes, and oils, and it serves as a component in jet fuels. The rightmost synthesis plans in Fig.Â 1 start with two affixations followed by two cyclizations. The leftmost plans alternate between an affixation and a cyclization. The bonds in the bond set are red and dashed.
Obviously, there can be several plans for the same target molecule. As an example, one can consider the bond set as a summary of the synthesis planÂ [8], actually representing a larger set of alternative synthesis plans arising from considering different orders of fixing the bonds. These plans may differ substantially in their yield, lab resource consumption, and environmental side effects. Thus, for a given set of synthesis plans there is a need to find the best. To this end, several quality measures for ranking synthesis plans have been proposed. Two classical ones are the external path length (\({{\mathrm{EPL}}}\)) and total weight of starting materials (\({{\mathrm{TW}}}\)).
The measure \({{\mathrm{EPL}}}\) was introduced by HendricksonÂ [8], and is defined as the sum of the numbers of reactions from each starting material to the target. When modeling synthesis plans as unarybinary trees, this is the sum of the lengths of all roottoleaf paths, which is also known as the external path length of the tree. This measure optimizes the convergencyÂ [21] of the plans: fully convergent plans (balanced trees) minimizes \({{\mathrm{EPL}}}\), whereas linear plans maximizes it. The measure aims at reducing overall loss of material during the synthesis by reducing the number of reactions in which the average starting material takes part. However, we demonstrate later in the paper that this classic quality measure has intrinsic inconsistencies which could make its use questionable.
The measure \({{\mathrm{TW}}}\) is defined as the total weight of starting materials in grams needed to produce one gram of the target molecule, and hence is a more direct description of the overall loss of material. This measure was described by HendricksonÂ [8] and later by SmithÂ [9]. The two authors differ in the way the value is calculated. In â€śAppendix 4: Total weight of starting materialsâ€ť we demonstrate that Smithâ€™s definition is in fact a generalization of that of Hendrickson, hence we here focus on the definition by Smith.
In the unarybinary tree representation of a synthesis plan, an edgeÂ e in the tree connects an input moleculeÂ v of a reaction with its output moleculeÂ u. Smith assumes knowledge of the loss in each individual reaction, and expresses this by values \(r_e\) on all edgesÂ e, where \(r_e\) is the amount in grammes of moleculeÂ v needed to create one gram of moleculeÂ u. Let \(P_{i}\) be the path from the root to leaf i. The total weight of starting materialÂ i needed to produce one gram of target is then equal to the product of the \(r_e\) values along \(P_i\). Thus, the total weight of starting materials needed to produce one gram of target is the sum of these values over all paths. Hence,
As Smith notes, by adding virtual unary reactions below all leaves with \(r_e\) values signifying price per gram, \({{\mathrm{TW}}}\) can easily express price rather than weight. In \({{\mathrm{TW}}}\), the cost of a reaction is measured per gram of output molecule produced, i.e., upstart costs of reactions are not accounted for. Hence, the quality measure is measuring the asymptotic cost when large amounts of the target molecule are to be produced.
Results
Representations of synthesis plans
In a synthesis plan, an intermediate molecule may be used as input in several reactions. Our starting point is the observation that in such cases, this intermediate molecule clearly should only be synthesized in one way: given two different ways to synthesize a given intermediate molecule, one will have the smallest asymptotic cost, and even if the two have equal costs, using both induces extra overhead.
This means that if an intermediate molecule appears more than once as a vertex in a unarybinary tree representation of a synthesis plan, its subtrees should be identical. To illustrate, in the tree in Fig.Â 2a, moleculeÂ C is synthesized in two different ways. However, either the tree Fig.Â 2b or the tree Fig.Â 2c must be cheaper, depending on the costs of the two ways of synthesizingÂ C. In short, while synthesis plans can be represented by unarybinary trees with nodes labeled by molecules, not all such unarybinary trees are realistic synthesis plans.
As a consequence, we believe synthesis plans are better described as directed acyclic graphs (DAGs) in which each vertex has a unique vertex label, each vertex has outdegree zero, one or two (depending on whether it represents a starting material, a product of a cyclization, or a product of an affixation, respectively), there is exactly one vertexÂ t with indegree zero (representing the target molecule), and there is a path fromÂ t to any other vertex in the DAG. Such a DAG can be obtained from the unarybinary tree structure by merging vertices with the same label. Vice versa, a tree structure can be obtained from the DAG by a depthfirst search from the root of the DAG, in a version which allows revisits to vertices. In Fig.Â 3b, the DAG arising from the unarybinary tree in Fig.Â 3a is shown.
In the DAG (as well as in unarybinary trees), labels of vertices are molecules. For this labeling to be chemically meaningful, the labels cannot be arbitrary, but should reflect the reactions involved. We now formalize this, using graph models of molecules as labels.
If edge (v,Â u) is in the DAG, we denote vertexÂ u a child of v. A vertex with outdegree zero we denote a leaf. A molecule is an undirected, connected, labeled graph, where labels are atom types. A building block of a DAG is a nonleaf vertex v together with every child u of v and its corresponding edge (v,Â u). In a DAG with nodes labeled by molecules, a building block is a reaction if it satisfies the following: (1) v has one or two children. (2) If v has one childÂ u, the label of v is obtained from the label of u by adding exactly one edge. This is a cyclization. (3) If v has two childrenÂ \(u_1\) and \(u_2\), then the label of v is obtained from the labels of \(u_1\) and \(u_2\) by adding exactly one edge connecting these labels. This is an affixation. A starting material is a molecule that can be acquired without the need to plan how to synthesize it.
Definition 1
A synthesis plan for t is a labeled DAG with the following properties:

1.
Vertex labels are molecules, and each label is unique.

2.
Each building block is a reaction.

3.
There is exactly one vertex with indegree zero, namelyÂ t.

4.
The label of each leaf is a starting material.
Our next observation is that such DAG models of synthesis plans can be represented as directed hypergraphs. A hypergraph differs from a standard graph in that edges connect sets of vertices rather than single vertices. More precisely, a hyperarc is an ordered pair of vertex (multi)sets. In chemistry, a reaction is a multiset of reactants and a multiset of products, and can therefore be seen as a hyperarc. As we only model construction reactions, all heads are singletons in this paper. In Fig.Â 3c, the reactions of Fig.Â 3b are depicted as hyperarcs.
When we say that a hyperarc represents a chemical reaction, we mean that its vertices are labeled with molecules, and that the label of the head is obtained from the labels of the tail under the reaction in question, analogously to the definition of a reaction in a DAG given above.
Hypergraphs are well suited for modeling chemistry, because they make the relationship between all molecules involved in a reaction explicit. This is in contrast to a DAG or a tree, where the two reactants in a reaction are only indirectly related via their common product.
In a hypergraph representation of the synthesis plan, adding a dummy source vertex s, together with a directed hyperarc \((\{s\}, \{i\})\) to each starting material i of the synthesis plan (as shown in Fig.Â 3c), gives a hypergraph which is in fact a hyperpath. This allows us to think of a synthesis plan as a form of path, hence to think of optimal synthesis plans as optimal paths. Given a larger hypergraph modeling the reactions in a part of chemistry under consideration, the search for optimal synthesis plans within this chemistry then becomes a search for optimal paths in the hypergraph.
Below, we recap basic hypergraph terminology, and then show how to use hypergraphs for finding synthesis plans.
Hypergraphs
A directed hypergraph is a set V of vertices and a set E of hyperarcs, where each hyperarc \(e=(T(e), H(e))\) is an ordered pair of nonempty multisets of vertices. The set T(e) is denoted the tail of the hyperarc and H(e)) the head. If \(H(e) = 1\), the hyperarc is denoted a Bhyperarc, and the notation for the single head vertex is h(e). A hypergraph with only Bhyperarcs is denoted a Bhypergraph. In this paper, we only consider Bhypergraphs. The size of a Bhypergraph is given by \({{\mathrm{size}}}(H)=\sum _{e\in E}(T(e) + 1)\). A hypergraph \(H'=(V',E')\) is a subhypergraph of \(H=(V,E)\) if \(V'\subseteq V\) and \(E'\subseteq E\).
A (plain) path \(P_{st}\) from s to t in a Bhypergraph is a sequence \(P_{st}=\langle s, e_1, v_1, e_2, v_2, \dots , v_{q1}, e_q,t \rangle\) of vertices and Bhyperarcs such that \(s \in T(e_1)\), \(t=h(e_q)\) and \(v_i=h(e_i) \in T(e_{i+1})\) for \(i=1..q1\). Its length \(P_{st}\) is the number q of hyperarcs. If \(t\in T(e_1)\), then \(P_{st}\) is a cycle. A hypergraph is acyclic if it does not contain any cycles.
The above concept of paths is only used for defining cycles. The proper generalization of directed paths to hypergraphs is that of hyperpaths. There are different ways of defining thisâ€”we use a variation based onÂ [24]. For a general overview seeÂ [25]. Examples of what constitutes a hyperpath and what does not are given in â€śAppendix 1: Hyperpathsâ€ť.
Definition 2
A hyperpath \(\pi _{st}=(V_\pi , E_\pi )\) from a source vertex s to a target vertex t in a Bhypergraph H is a subhypergraph of H with the following properties: If \(t=s\), then \(V_\pi = \{s\}\) and \(E_\pi = \emptyset\). Otherwise, \(E_\pi\) can be ordered in a sequence \(\langle e_1, e_2, \ldots , e_q \rangle\) such that

(1)
\(T(e_i)\subseteq \{s\} \cup \{h(e_1), h(e_2), \ldots , h(e_{i1})\}\) for allÂ i

(2)
\(t=h(e_q)\)

(3)
Every \(v \in V_\pi {\setminus } \{ t \}\) has at least one outgoing hyperarc in \(E_\pi\), and t has zero.

(4)
Every \(v \in V_\pi {\setminus } \{s\}\) has exactly one ingoing hyperarc in \(E_\pi\), and s has zero.
Note that DefinitionÂ 2(4) gives a 1â€“1 correspondence between \(E_\pi\) and \(V_\pi {\setminus } \{s\}\), hence we can define unique indices for the vertices inÂ \(V_\pi {\setminus } \{s\}\) by \(v_i = h(e_i)\). We let \(v_0\) be s. The hyperarcÂ \(e_i\) is called the predecessor hyperarc of \(v_i\) and the corresponding map \(p: V_\pi {\setminus } \{s\} \mapsto E_\pi\) is called the predecessor function of \(\pi _{st}\)Â [20]. We use the notation \(\pi _{st} = \langle p(v_1), p(v_2),\ldots ,p(v_{q1}), p(t) \rangle\) for hyperpaths from now on. If a subhypergraph of a hyperpath \(\pi _{st}\) is a hyperpath itself, it is called a subhyperpath of \(\pi _{st}\). We will later need the following fact.
Lemma 1
Let \(\pi _{st} = \langle p(v_1), p(v_2),\ldots ,p(v_{q1}), p(t) \rangle\) be a hyperpath from s to t. Then for any \(v_i\), there is a unique subhyperpath \(\pi _{sv_i}\) of \(\pi _{st}\) from s to \(v_i\).
Proof
By DefinitionÂ 2(2) and (4), any subhyperpath from s to \(v_i\) must contain the set \(\pi _{sv_i}\) of hyperarcs returned by the procedure Backtrack listed in AlgorithmÂ 1. It is easy to verify that \(\pi _{sv_i}\) fulfills the requirements DefinitionÂ 2(1)â€“(4). For uniqueness, let \(\pi '_{sv_i}\) be a hyperpath from s to \(v_i\), let \(E'\) be the hyperarcs of \(\pi '_{sv_i}\) not in \(\pi _{sv_i}\), and let \(e_j\) be the hyperarc of \(E'\) with highest indexÂ j. By DefinitionÂ 2(3), \(v_j\) must have an outgoing hyperarc e. By DefinitionÂ 2(1) and the maximality ofÂ j, we cannot have \(e \in E'\), and by the marking strategy of the algorithm, it cannot be a hyperarc of \(\pi _{sv_i}\). Hence, \(E'\) is empty and \(\pi _{sv_i} = \pi '_{sv_i}\). \(\square\)
Finding synthesis plans via hypergraphs
The overall goal of this paper is to find synthesis plans within a given chemistry. We assume the chemistry is described by a (possibly large) set of construction reactions, i.e., affixations and cyclizations. Above, we described how to model synthesis plans as hypergraphs. In this section, we show how to view the set of reactions of the given chemistry as a single, large hypergraph, and how this in turn will allow us to find synthesis plans within the chemistry simply by looking for hyperpaths in this hypergraph.
Let R be a set of reactions, and let S be a set of starting materials. We define the hypergraph, called the Hypergraph of Reactions (\({{\mathrm{HoR}}}\)) induced by R and S, as follows.
Definition 3
Let \(E_R\) be the representation of R as a set of hyperarcs. Let \(V_R\) be the set of vertices appearing in the heads and tails of the hyperarcs in \(E_R\). Vertices with the same label (i.e., representing the same molecule) are considered identical. Let \(V_S\) be the set of vertices with labels in S. Then, the hypergraph of reactions (\({{\mathrm{HoR}}}\)) is the hypergraph
where s is a dummy vertex and \(E_s = \{ (\{s\},\{v\}) \mid v \in V_S \}\) is a set of dummy hyperarcs.
An example \({{\mathrm{HoR}}}\) with R and S being the combined sets of reactions and starting materials from the three synthesis plans for decalin in Fig.Â 1a is depicted in Fig.Â 4.
The crux of our paper is captured by the following theorem.
Theorem 1
Let \(H=(V,E)\) be a HoR induced by reactions R and starting materials S. Let v be a vertex from \(V_R\) and let t be its label. Then there is a 11 correspondence between (a) the synthesis plans for t with reactions from R and starting materials from S and (b) the hyperpaths in H from s to v.
Proof
Let \(\sigma\) be a synthesis plan from (a). To map it to a hyperpath in (b), do as follows. Add a dummy vertexÂ s and a dummy edge from each leaf of \(\sigma\)â€“s. This result is still a DAG, hence admits a topological ordering of its vertices, i.e., a linear order on its vertices such that all edges point in the same direction. Convert each reaction and dummy edge of the DAG into a hyperarc in the natural way, cf. Fig.Â 3, reversing the direction. Let \(E_{\pi }\) be the resulting hyperarcs, and let \(V_{\pi }\) be the vertices of the DAG. Then \(\pi = (V_{\pi }, E_{\pi })\) is a hyperpath: DefinitionÂ 2(4) follows because a building block of a DAG vertex contains all the outgoing DAG edges of the vertex. Due to DefinitionÂ 2(4), the topological ordering of the DAG vertices induces an ordering of \(E_{\pi }\) fulfilling DefinitionÂ 2(1). DefinitionÂ 1(iii) induces DefinitionÂ 2(3) and, combined with the topological ordering, also DefinitionÂ 2(2).
Conversely, let \(\pi\) be a hyperpath from (b). To map it to a synthesis plan in (a), do as follows: FromÂ \(\pi\) remove s and its outgoing dummy hyperarcs, and convert every hyperarc to a building block in the natural way, reversing the direction. The result is a synthesis plan: DefinitionÂ 1(i) and (ii) follow by what it means for a hyperarc to represent a reaction and by the uniqueness of vertex labels in DefinitionÂ 3. DefinitionÂ 1(i) follows from DefinitionÂ 2(3). DefinitionÂ 1(iv) follows from DefinitionÂ 2(4) and the fact that only dummy hyperarcs have been removed, each of which by definition points to a starting material.
Clearly, the two mappings are each otherâ€™s inverses.\(\square\)
As a consequence of TheoremÂ 1, algorithms computing hyperpaths in hypergraphs are also algorithms computing synthesis plans. In particular, we claim that an algorithm by Nielsen et al.Â [20] for finding the K shortest hyperpaths in a Bhypergraph can be used to find the K best synthesis plans for a target moleculesÂ t, given a set of reactions and a set of starting materials. We now verify the details of this claim.
The algorithm by Nielsen et al. is based on Yens classic algorithmÂ [26] for shortest paths in directed (standard) graphs. The overall idea is to find the single shortest hyperpath and then recursively consider all ways in which a hyperpath can deviate from the shortest hyperpaths found so far, using single shortest hyperpath computations as a subroutine. For an acyclic Bhypergraph \(H=(V,E)\), the single shortest hyperpath can be computed using dynamic programmingÂ [9] in \(O(V+{{\mathrm{size}}}(H))\) time, leading to a runtime for the algorithm by Nielsen et al. of \(O(KV(V+{{\mathrm{size}}}(H)))\) on such hypergraphs. The requirement of acyclicity can be lifted (at the expense of a slight increase in runtime) by using different algorithms for finding single shortest hyperpathsÂ [27], whereas the algorithm by Nielsen et al. assumes the hypergraph to be a Bhypergraph.
Any \({{\mathrm{HoR}}}\) H is acyclic and satisfies \({{\mathrm{size}}}(H)\le 3E\). The former is because every reaction has a strict increase from reactants to product in the number of edges in the molecule labels, and the latter is because every hyperarc e in a \({{\mathrm{HoR}}}\) is a Bhyperarc with \(T(e) \le 2\).
Finally, the algorithm by Nielsen et al. requires the lengths of hyperpaths to be given by what is called an additive weight function. We will later demonstrate that the very generic quality measure \({{\mathrm{TW}}}\) for synthesis plans can be expressed in this form.
These properties combined with TheoremÂ 1 give the following result.
Theorem 2
Given a HoRÂ \(H = (V,E)\) and a targetÂ \(t \in V\), the K best synthesis plans forÂ t in H, ranked according to the measure TW, can be found in time \(O(KV(V+E))\).
A detailed exposition of the algorithm by Nielsen et al. is given in â€śAppendix 2: The K best plans algorithmâ€ť.
The sets R and S of reactions and starting materials in the \({{\mathrm{HoR}}}\) can arise from many sources. As in Fig.Â 4, a set of known synthesis plans for a targetÂ t can be combined to a \({{\mathrm{HoR}}}\) which could then contain further, unknown plans. Another approach could be to generate the reactions of the \({{\mathrm{HoR}}}\) by recursively breaking the bonds of the targetÂ t in all possible ways. This could be all bonds ofÂ t (possibly stopping the recursion when a specified minimum size of intermediate molecules is met), or it could be a subset of bonds (i.e., a bond set) selected by methods from the classic retrosynthetic approachÂ [1]. In â€śAppendix 3: Bond set based HoR constructionâ€ť, we provide the algorithmic details of efficiently breaking a bond set in all possible ways. More generally, any database of reactions and starting materials describing a chemistry under consideration can be used as R and S. These databases can be based on published literature and patents, such asÂ ReaxysÂ [28] and SciFinderÂ [29]. Recent developments for retrosynthetic reaction prediction [30,31,32] even allow for the inference of unknown reactions. As these automated prediction methods have already proven to be highly accurate, finding the K shortest hyperpaths also has potential for discovering novel synthesis plans employing such predicted reactions.
Quality measures
The algorithm of Nielsen et al. requires the lengths of hyperpaths to be given by an additive weight function. In this section, we investigate whether existing quality measures for synthesis plans can be expressed in this form, and we show that the very generic measure \({{\mathrm{TW}}}\) indeed can. On the other hand, this turns out to not be the case for the classic measureÂ \({{\mathrm{EPL}}}\). The reasons are inconsistencies that we demonstrate are inherent in the measure. This is a bit surprising in light of its use in previous work, but the implication seems to be that the \({{\mathrm{EPL}}}\) measure should be used with caution.
An additive weight function W assigns weights to hyperpaths in an inductive manner. For our purposes, we only need a special case, often denoted a value function (for a more general definition of additive weight functions, seeÂ [27]): For each hyperarcÂ e and each vertexÂ v in its tailÂ T(e), let \(a_{v,e}\) be a nonnegative real number. Then for a hyperpath \(\pi _{st}\) from s to t, the weightÂ \(W(\pi _{st})\) is one if \(t = s\), and is otherwise given recursively by
where the \(\pi _{sv}\)â€™s are the subhyperpaths fromÂ s to the verticesÂ v in the tail of last hyperarc p(t) of \(\pi _{st}\). These subhyperpaths exist and are unique by LemmaÂ 1. They also contain strictly fewer hyperarcs, so the recursion stops eventually. Hence, W is welldefined.
Total weight of starting materials We defined the quality measure total weight of starting materials (\({{\mathrm{TW}}}\))Â in â€śSynthesis planning basicsâ€ť section, expressed in unarybinary trees. Recall that \({{\mathrm{TW}}}\) expresses how much starting material is needed to produce one gram of target molecule, taking yields of reactions into account. In the hyperpath setting, the definition becomes the following. For a reaction e with a reactant v, the retro yield \(r_{v,e}\) is the amount of v in grams needed in reaction e to create one gram of the product h(e). Thus, \(r_{v,e}\ge 0\), and by mass conservation \(\sum _{v}{r_{v,e}}\ge 1\) for any reaction e. FigureÂ 5 shows the HoR from Fig.Â 4 decorated with example retro yields.
Each (plain) stpath \(P_{st}=\langle s,e_1,v_1,e_2,v_2,\ldots ,e_{P_{st}}, t\rangle\) contained in the hyperpath of the synthesis plan induces a use of starting materialÂ \(v_1\) given by the product of the retro yields along the path. The product along a path is \(\prod _{i=1}^{P_{st}}{r_{v_{i1},e_{i}}}\), where we for each hyperarc e from the dummy vertex s to a starting material define \(r_{s,e} = 1\). Thus, the total weight of starting materials needed for a synthesis plan represented by a hyperpath \(\pi _{st}\) is
This can be rephrased inductively as follows
This is most easily seen in the traditional tree notation for synthesis plans, cf. Fig.Â 3. Thus, \({{\mathrm{TW}}}\) can indeed be expressed as an additive weight function, cf. Eq.Â (2). The measureÂ \({{\mathrm{TW}}}\) is actually very generic in natureÂ [9]. For example, it can easily be adjusted to calculate the total price of the starting materials if a price per gram \(p_v\) is known for each starting material v, simply by setting \(r_{s,e} = p_v\) for the hyperarc e from s to v. It can also incorporate nonchemical expenses of reactions, such as cost of energy usage or cost of disposal of waste products, simply by adding s to the tail of any hyperarcÂ e representing a reaction and setting \(r_{s,e}\) to the nonchemical expense per gram product produced inÂ e. Even more generally, we note that any measure which can be described as an additive weight functionÂ [27] is compatible with our method.
External Path Length Recall from â€śSynthesis planning basicsâ€ť section that the quality measure external path length (\({{\mathrm{EPL}}}\))Â [8] is the sum of the lengths of all paths from the root to the leaves. When trying (and failing) to express \({{\mathrm{EPL}}}\) as an additive weight function, we discovered a certain peculiarity inherent in the measure: the optimal synthesis plan for a molecule depends on how the molecule is later used. More precisely, what constitutes the best (sub)synthesis plan for an intermediate molecule inside a larger synthesis plan depends on where in the large plan the molecule is used. This does not correspond to physical reality, since different instances of a molecule are not distinguished after creation. As a consequence, in an optimal plan (w.r.t. \({{\mathrm{EPL}}}\)) where the same intermediate molecule appears twice, the plan could ask for different subplans for it. As we argued at the start of the â€śResultsâ€ť section, such a plan would never be used in practice.
We now demonstrate the above inconsistency by an example, expressed using unarybinary trees (the model in which \({{\mathrm{EPL}}}\) was originally definedÂ [8]).
Consider a (hypothetical) moleculeÂ M, and assume it can be synthesized using two different bond sets \(M'\) and \(M''\), as depicted in the top row of Fig.Â 6. \(M'\) admits only linear synthesis plans, whereas \(M''\) has many, including a fully convergent one. These synthesis plans are depicted in the bottom row of Fig.Â 6.
For synthesizingÂ M by itself, the measure \({{\mathrm{EPL}}}\) is minimized by the fully convergent plan for the bond setÂ \(M''\). However, consider the moleculeÂ T depicted in Fig.Â 7a, with the synthesis plan depicted in Fig.Â 7b. In this synthesis plan, the moleculeÂ M appears twice, with different subsynthesis plans. According to \({{\mathrm{EPL}}}\) these different synthesis plans forÂ M are indeed the optimal choices at these two positions in the remaining plan, as the reader can readily verify. For instance, the two alternatives shown in Fig.Â 8a, b have \({{\mathrm{EPL}}}=98\) and \({{\mathrm{EPL}}}=97\), while that of Fig.Â 7b has \({{\mathrm{EPL}}}=96\). In other words, according to \({{\mathrm{EPL}}}\), the position ofÂ M in the large plan determines how it should be made. We note that already in [8], Hendrickson expressed some reservations about the reliability of the measure as a cost function, but in less explicit terms than the phenomenon demonstrated above.
Discussion
In this section, we discuss our approach in a practical context. Using decalin as an example, we first show that even small molecules admit a large number of synthesis plans. We next investigate how sensitive the ordering of these plans is to changes in the yields of reactions. Finally, we compare a formal synthesis plan to a fully detailed synthesis plan from the literature, illustrating the difference in level of details included. All three aspects demonstrate that having K good synthesis plans available is a clear advantage over having just the single best plan.
An implementation of the algorithms in â€śAppendix 2: The K best plans algorithmâ€ť andÂ â€śAppendix 3: Bond set based HoR constructionâ€ť can be acquired upon request by email to the authors.
Number of synthesis plans for decalin
Recall that decalin is a bicyclic organic molecule with ten carbon atoms (Fig.Â 1). It has previously been used as an example molecule in graph theoretic approaches to synthesis planningÂ [6]. Below, we use it to demonstrate that even small molecules typically lead to a large variety of synthesis plans.
We consider synthesis plans based on bond sets up to size four. A bond set can be represented as an edgecolored molecule graph, in which red edges are in the bond set and black edges are not. From this, the number of nonisomorphic bond sets of a certain size can be calculated by a straightforward application of PĂłlyaâ€™s Enumeration TheoremÂ [33]: decalin has four nonisomorphic bond sets of size one, 18^{Footnote 2} nonisomorphic bond sets of size two, 47 nonisomorphic bond sets of size three, and 92 nonisomorphic bond sets of size four.
For each of the 92 bond sets of size four, we count how many different plans this leads to. We do this by creating the \({{\mathrm{HoR}}}\) based on the bond set in question (using the algorithm in â€śAppendix 3: Bond set based HoR constructionâ€ť) and then computing the K shortest hyperpath for \(K = \infty\) (using the algorithm in â€śAppendix 2: The K best plans algorithmâ€ť). Of these 92 bond sets, two lead to three different synthesis plans each (these are depicted in Fig.Â 1), one leads to five different synthesis plans (Fig.Â 9), one leads to eight synthesis plans (Fig.Â 10), and the rest each leads to at least ten possible synthesis plans (one example is given in Fig.Â 11). The maximum number for a single bond set is 38 different plans. The total number of plans in the collection is 1711.^{Footnote 3}
In more detail, consider the example of the bond set depicted in Fig.Â 10. It gives rise to eight different synthesis plans, distributed over two different unarybinary tree topologies. Considering leaf vertex labels only (as often done in chemical literature) there are five different labeled unarybinary tree topologies. However, for three out of these five leafvertexlabeled trees, one internal vertex may have two different labels, which leads to the final eight different synthesis plans.
From numbers above, we see that even small molecules can have a large number of possible synthesis plans. For larger molecules, an exhaustive enumeration becomes very costly in terms of computation time, and having a polynomial time algorithm for returning theÂ K best is a strong asset.
Order of synthesis plans
We now add retro yields to the synthesis plans of decalin. For each bond set, two different sets of example retro yields were used: one for which \(\sum _{v\in T(e)} r_{v,e} = 1.25\) for each hyperarc e representing a reaction, and one for which \(\sum _{v\in T(e)} r_{v,e} = 2.5\). These two cases correspond to a yield of \(1/1.25 = 80\%\) and \(1/2.5 = 40\%\), respectively. For each reaction, the retro yields are distributed between the reactants in proportion to their number of carbon atoms.
As an example, consider the three synthesis plans of Fig.Â 1a. With a yield of 80% in each reaction, one can verify that the total weight of starting materials needed to create one gram of decalin is 2.27Â g in the case where the first affixation is followed by a cyclization, and 2.34Â g in the two cases where both cyclization reactions are performed in the end. With a yield of 40%, the corresponding numbers are 32.5 and 34.4Â g. Fig.Â 5 shows the \({{\mathrm{HoR}}}\) of these three plans decorated with the retro yields corresponding to 80% yield.
As another example, consider the eight plans in Fig.Â 10. Using a yield of 80% in each reaction, one can verify that the best plan is the top leftmost plan. This has a total weight of starting materials of 1.87Â g. With a yield of 40%, the best plan is the top rightmost plan with a total weight of starting materials of 15.63Â g.
From all synthesis plans of all possible bond sets of sizeÂ 4, the best possible total weight turns out to be 1.72Â g if the yield is 80%, and 10.0Â g if the yield in each reaction is 40% (plans not among those depicted).
We now try to quantify how much the total ordering among all the plans changes when switching between these two sets of retro yields. This will give information on how sensitive the ranking of plans is to changes in the yields of reactions. For a given bond set, the two yield values 80 and 40% used above each gives rise to a ranking of the synthesis plans of the bond set. LetÂ i be the first position where these rankings disagree, i.e., the first \(i1\) best plans are the same in the two rankings, but the iâ€™th plan is not. For each possible value ofÂ i, we count how many of the 92 different bond sets have this value as the first position where the rankings disagree. These counts are listed in TableÂ 1 as \({{\mathrm{Count}}}(i)\).
When planning, yields are often not known with high precision (and may even change over time as lab experience with the chosen reactions grows). The above shows that some plans may be quite sensitive to the exact yield values. Running our algorithm for two different sets of yield values and a fairly largeÂ K, and then taking the intersection of the results, is a way to learn which among the good plans are robust towards uncertainties in the yield values.
Detailed chemical synthesis plan for a size 2 bond set for decalin
As discussed earlier, synthesis planning often proceeds in two phases, the first of which is identification of a set of construction reactions, and the second is consideration of functionalization reactions.
In this section, we want to illustrate the difference between a skeleton plan from the first phase and a detailed synthesis plan including the functionalization reactions from the second phase. As will be apparent, the difference can be large. Hence, the single best plan from phase one may easily turn out to be infeasible under actual lab conditions. Being able to find the KÂ best plans in phase one gives a much more robust strategy, since this gives a number good plans on which practitioners can build in phase two.
We use the synthesis of the WielandMiescher Ketone (WMK) as an example. WMK is a key building blockÂ [34] in the total synthesis of numerous natural products possessing a wide spectrum of biological activity. The reaction (also known as HajosParrishEderSauerWiechert reaction) is one of the first examples of asymmetric organocatalysis. The overall reaction is depicted in the top left of Fig.Â 12. It corresponds to the phase one plan shown in top right of Fig.Â 12, which has decalin as skeleton molecule and a bond set of size two. Interestingly, only the shown size two bond set has been under heavy investigation, and many different organocatalysts have been tried out to improve the yield and enatiomeric access of the reaction. Alternative bond sets, however, have only occasionally been tried out, which is surprising given the central role of WMK as a versatile building block in natural product synthesis. The affixation and cyclization steps require quite heavy valence electron rearrangements as illustrated by arrows in the two bracketed transition states in the lower part of Fig. 12. Furthermore, the synthetic target WMK is garnished with functional groups and chiral centers which are not considered in the phase one plan.
Conclusions
We have demonstrated that a core part of chemical synthesis planning can be phrased as a combinatorial optimization problem on hypergraphs by modeling individual synthesis plans as directed hyperpaths embedded in a hypergraph of reactions (\({{\mathrm{HoR}}}\)) representing the chemistry of interest. An immediate consequence is that the K best synthesis plans for a given target can be computed in polynomial timeÂ [20] for a number of quality measures of practical importance, and indeed for any measure which can be expressed as an additive weight function. The polynomial runtime makes it feasible to do this even for bigÂ K and large molecules. Having K good plans to choose from has many benefits: it makes the synthesis planning process much more robust towards actual feasibility when in later stages adding functionalization reactions and other chemical details, it allows one to combine several quality measures, and it provides a way to deal with imprecise yield estimates.
Looking at the standard retrosynthetic approach, the obvious type of \({{\mathrm{HoR}}}\) is defined using a fixed target and a bond set, cf.Â the algorithm described in â€śAppendix 3: Bond set based HoR constructionâ€ť. However, our modeling is not restricted to this. For instance, it is possible to combine any number of known synthesis plans for a target molecule into a \({{\mathrm{HoR}}}\), from which new hybrid plans may arise. More generally, any database of reactions and starting materials can be used to define a \({{\mathrm{HoR}}}\).
Along the way, we also demonstrated that the classic quality measure \({{\mathrm{EPL}}}\) has a builtin inconsistency which could render its use in synthesis planning questionable.
The work presented here is one step towards improving chemical synthesis planning in the light of developments in graph and hypergraph algorithms. A natural next step would be to attempt to add more chemical detail in the modeling. For instance, one could try to include refunctionalization reactions and to consider strategies for introducing and removing protective groups within this modeling framework.
Notes
Not to be confused with the simpler concept of (nonhyper) paths in the often used bipartite graph representation of hypergraphs.
Note that BertzÂ [6] also counts bond sets of size two, but does not consider isomorphism issues and hence arrives at a larger number.
In this sum, we did not check for isomorphic plans arising from different bond sets.
If several orderings are legal (cf. DefinitionÂ 2), any can be used.
In others of the synthesis plans forÂ t, this intermediate molecule may not appear because its parts are combined with other intermediate molecules, which is the reason why such a bond set can be meaningful
Smithâ€™s original definition was for synthesis plans modeled as hypergraphs. We here use unarybinary trees in order to compare to Hendricksonâ€™s definition.
References
Corey EJ, Wipke WT (1969) Computerassisted design of complex organic syntheses. Science 166:178â€“192
Hendrickson JB, BraunKeller E, Toczko GA (1981) A logic for synthesis design. Tetrahedron 37 Suppl. I:359â€“370
Todd MH (2005) Computeraided organic synthesis. Chem Soc Rev 34:247â€“266
Andraos J (2012) The algebra of organic synthesis: green metrics, design strategy, route selection, and optimization. CRC Press, Boca Raton
RĂĽcker C, RĂĽcker G, Bertz SH (2004) Organic synthesisart or science? J Chem Inf Comput Sci 44(2):378â€“386
Bertz SH, Sommer TJ (1993) Application of graph theory to synthesis planning: complexity, reflexivity and vulnerability. In: Hudlicky T (ed) Organic synthesis: theory and applications. JAI Press, Greenwich, pp 67â€“92
Hoffmann RW (2009) Elements of synthesis planning. Springer, Berlin
Hendrickson JB (1977) Systematic synthesis design. 6. Yield analysis and convergency. J Am Chem Soc 99:5439â€“5450. https://doi.org/10.1021/ja00458a035
Smith WD (1997) Computational complexity of synthetic chemistryâ€“basic facts. Technical report. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.49.9276. Accessed on Jan 2018
Bertz SH (2003) Complexity of synthetic routes: linear, convergent and reflexive syntheses 1. New J Chem 27(5):870â€“879
Gelernter HL, Sanders AF, Larsen DL, Agarwal KK, Boivie RH, Spritzer GA, Searleman JE (1977) Empirical explorations of SYNCHEM. Science 197(4308):1041â€“1049
Corey EJ, Howe WJ, Orf HW, Pensak DA, Petersson G (1975) General methods of synthetic analysis. Strategic bond disconnections for bridged polycyclic structures. J Am Chem Soc 97(21):6116â€“6124
Corey EJ, Cheng X (1995) The logic of chemical synthesis. Wiley, New York
Nowak G, Fic G (2012) Generation of chemical transformations: reaction pathways prediction and synthesis design. In: EmmertStreib F, Dehmer M, Varmuza K, Bonchev D (eds) Statistical modelling of molecular descriptors in QSAR/QSPR, vol 2. Wiley, Weinheim, pp 393â€“425
Hendrickson JB (2002) Generating benign alternative syntheses: the SynGen program, pp 127â€“144. https://doi.org/10.1021/bk20020823.ch010
Wipke WT, Rogers D (1984) Artificial intelligence in organic synthesis. sst: starting material selection strategies. an application of superstructure search. J Chem Inf Comput Sci 24(2):71â€“81
Hanessian S, Franco J, Larouche B (1990) The psychobiological basis of heuristic synthesis planning man, machine and the chiron approach. Pure Appl Chem 62(10):1887â€“1910
Mehta G, Barone R, Chanon M (1998) Computeraided organic synthesissesam: a simple program to unravel â€śhiddenâ€ť restructured starting materials skeleta in complex targets. Eur J Organ Chem 7:1409â€“1412
Gillet VJ, Myatt G, Zsoldos Z, Johnson AP (1995) Sprout, hippo and caesa: tools for de novo structure generation and estimation of synthetic accessibility. Perspect Drug Discov Des 3(1):34â€“50
Nielsen LR, Andersen KA, Pretolani D (2005) Finding the \(K\) shortest hyperpaths. Comput Oper Res 32(6):1477â€“1497
Velluz L, Valls J, Mathieu J (1967) Spatial arrangement and preparative organic synthesis. Angew Chem Int Ed Engl 6:778â€“789
Kim SM, PeĂ±a MI, Moll M, Bennett GN, Kavraki LE (2017) A review of parameters and heuristics for guiding metabolic pathfinding. J Chem Inform 9(1):51. https://doi.org/10.1186/s1332101702396
Carbonell P, Fichera D, Pandit SB, Faulon JL (2012) Enumerating metabolic pathways for the production of heterologous target chemicals in chassis organisms. BMC Syst Biol 6(1):10. https://doi.org/10.1186/17520509610
Ausiello G, Franciosa PG, Frigioni D (2001) Directed hypergraphs: problems, algorithmic results, and a novel decremental approach. Theoretical Computer Science, vol 2202. Lecture Notes in Computer Science. Springer, Berlin, pp 312â€“328
Thakur M, Tripathi R (2009) Linear connectivity problems in directed hypergraphs. Theor Comput Sci 410(27â€“29):2592â€“2618. https://doi.org/10.1016/j.tcs.2009.02.038
Yen JY (1971) Finding the \(k\) shortest loopless paths in a network. Manag Sci 17:712â€“716
Gallo G, Longo G, Pallottino S, Nguyen S (1993) Directed hypergraphs and applications. Discr Appl Math 42:177â€“201
https://new.reaxys.com. Accessed on Jan 2018
http://www.cas.org/products/scifinder. Accessed Jan 2018
Liu B, Ramsundar B, Kawthekar P, Shi J, Gomes J, Nguyen QL, Ho S, Sloane J, Wender P, Pande V (2017) Retrosynthetic reaction prediction using neural sequencetosequence models. ACS Cent Sci 3(10):1103â€“1113. https://doi.org/10.1021/acscentsci.7b00303
Segler MHS, Waller MP (2017) Neuralsymbolic machine learning for retrosynthesis and reaction prediction. Chem Eur J 23(25):5966â€“5971. https://doi.org/10.1002/chem.201605499
Coley CW, Rogers L, Green WH, Jensen KF (2017) Computerassisted retrosynthesis based on molecular similarity. ACS Cent Sci 3(12):1237â€“1245. https://doi.org/10.1021/acscentsci.7b00355
PĂłlya G (1937) Kombinatorische anzahlbestimmungen fĂĽr gruppen, graphen und chemische verbindungen. Acta Math 68(1):145â€“254. https://doi.org/10.1007/BF02546665
Bradshaw B, Bonjoch J (2012) The Wielandâ€“Miescher Ketone: a journey from organocatalysis to natural product synthesis. SYNLETT 23:337â€“356. https://doi.org/10.1055/s00311290107
Gallo G, Pallottino S (1992) Hypergraph models and algorithms for the assembly problem. Technical report, Dipartimento di Informatica, UniversitĂˇ di Pisa, TR6/92
Heller SR, McNaught A, Stein S, Tchekhovskoi D, Pletnev IV (2013) InChIâ€”the worldwide chemical structure identifier standard. J Chem Inf 5:7
McKay BD, Piperno A (2014) Practical graph isomorphism II. J Symb Comput 60:94â€“112
Authorsâ€™ contributions
The order of authors is alphabetical, following the tradition from computer science. All authors contributed the the design of the study, the mathematical results, and the writing of the manuscript. All authors read and approved the final manuscript.
Acknowledgements
We thank Daniel Fentz Johansen and Carsten GrĂ¸nbjerg LĂĽtzen for their implementation of the algorithm for finding the K best synthesis plans as a part of their MSc thesis.
Competing interests
The authors declare that they have no competing interests.
Availability of data and materials
Not applicable.
Consent for publication
Not applicable.
Ethics approval and consent to participate
Not applicable.
Funding
This work was supported in part by the COST Action CM1304 â€śEmergence and Evolution of Complex Chemical Systemsâ€ť, in part by the Volkswagen Stiftung Project no. I/82719, in part by the Independent Research Fund Denmark, Natural Sciences, Grants DFF132300247 and DFF701400041, in part by the National Science Foundation (INSPIRE 1648973), and by the Danish foundation Oticon Fonden.
Publisherâ€™s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix 1: Hyperpaths
Examples of hyperpaths and nonhyperpaths. FigureÂ 13 is a hyperpath from s to t: each vertex (except s) has exactly one ingoing hyperarc, each vertex (except t) has at least one outgoing hyperarc, and the ordering \(\langle p(F), p(E), p(D), p(C), p(B), p(t)\rangle\) of the hyperarcs meets the condition of Definition 2(1). Figures 14, 15, and 16 are not hyperpaths: in Fig.Â 14, the vertex D has no ingoing hyperarc, in Fig.Â 15 the vertex B has two ingoing hyperarcs (a hyperpath can be obtained by deleting either of these hyperarcs), and in Fig.Â 16 the vertex B has no outgoing hyperarcs (a hyperpath can be obtained by deleting this vertex together with the incident hyperarc).
Appendix 2: The K best plans algorithm
As mentioned, a polynomial time algorithm for finding the K best hyperpaths in a hypergraph was given by Nielsen et al.Â [20]. We here explain the algorithm and illustrate how it works by an example.
Let \(H=(V,E)\) be a directed Bhypergraph, let \(s,t\in V\) be vertices for which there exists at least one hyperpath from s to t, let \(\mathcal {P}\) be the set of all hyperpaths from s to t, and let W be an additive weight function on hyperpaths, cf.Â Eq.Â (2). We assume the existence of an algorithm ShortestPath for computing a (single) optimal hyperpath according toÂ W. Let \(\pi _{st}\) be such an optimal hyperpath from s to t in H.
In the algorithm of Nielsen et al., the ordering \(\langle p(v_1), p(v_2),\dots , p(v_{q1}), p(t)\rangle\) of the hyperarcs of \(\pi _{st}\) is used^{Footnote 4} to partition the remaining hyperpaths into q disjoint subsets \(\mathcal {P}^i\), \(1\le i\le q\), as follows (where \(v_q\) denotes t): \(\mathcal {P}^i\) is the set of all hyperpaths from s to t containing the hyperarcs \(p(v_{i+1}),p(v_{i+2}),\dots ,p(v_{q1}),p(t)\) and not containing \(p(v_{i})\). In other words, each \(\mathcal {P}^i\) consists of all sthyperpaths that have the same last \(qi\) hyperarcs as \(\pi _{st}\) and deviate from \(\pi _{st}\) exactly at the ith hyperarc. Clearly, the \(\mathcal {P}^i\)s form a partitioning of \(\mathcal {P}{\setminus } \{\pi _{st}\}\).
The idea behind the algorithm is to view this partition of \(\mathcal {P}{\setminus }\{ \pi _{st}\}\) along \(\pi _{st}\) as a set of q new optimal hyperpath problems. Each set \(\mathcal {P}^i\) has an optimal hyperpath \(\pi ^i\), and the best of these, say \(\pi _j\), will be the optimal of the remaining hyperpaths \(\mathcal {P}{\setminus } \{\pi _{st}\}\), i.e., the second best hyperpath inÂ H. Now, output \(\pi _j\) and partition \(\mathcal {P}^j{\setminus } \{\pi _j\}\) along \(\pi _j\). To find the third best hyperpath, note that the sets of this partition together with the remaining sets \(\mathcal {P}^i\) for \(i=1,2 \dots j1,j+1 \dots q\) form a partition of \(\mathcal {P}{\setminus } \{ \pi _{st}, \pi _j\}\). Hence, the process can be continued in the same fashion, outputting the hyperpaths inÂ H in sorted order.
Storing \(\mathcal {P}\) or \(\mathcal {P}^i\) as actual sets of hyperpaths requires precomputation of all hyperpaths, which is undesirable. Instead, each set of sthyperpaths can be represented by a subhypergraph of HÂ [20]. H itself naturally contains all sthyperpaths of H and is thus the hypergraph representation of the set \(\mathcal {P}\). Each \(\mathcal {P}^i\) is represented by a hypergraph \(H^i=(V^i,E^i)\) obtained by H in the following manner:

The vertex set remains the same, i.e., \(V^i=V\).

The arc set \(E^i\) is obtained from E as follows:

The hyperarc \(p(v_i)\) is removed.

The hyperarcs \(p(v_{i+1}),p(v_{i+2}),\ldots ,p(v_{q1}),p(t)\) are fixed in \(H^i\). By this we mean that for each \(v_j, j > i\), all ingoing hyperarcs of \(v_j\) except \(p(v_j)\) are removed, making \(p(v_j)\) the only ingoing hyperarc to \(v_j\).

It is shown inÂ [20] that \(\pi ^i \in \mathcal {P}^i\) if and only if \(\pi ^i\) is a sthyperpath in \(H^i\).
The partition of a set of hyperpaths \(\widetilde{\mathcal {P}}\) along a hyperpath \(\widetilde{\pi } \in \widetilde{\mathcal {P}}\) is computed by the backwards branching procedure BackBranch, AlgorithmÂ 2. It takes as input the hypergraph representation \(\widetilde{H}\) of \(\widetilde{\mathcal {P}}\) and the hyperpath \(\widetilde{\pi } \in \widetilde{H}\) with q hyperarcs and predecessor function p. Each \(\widetilde{H}^i\) is computed by deleting \(p(v_i)\) and fixing the subsequent hyperarcs as described above (in AlgorithmÂ 2, \({{\mathrm{BS}}}(v)\) denotes the set of ingoing hyperarcs for vertex v). Finally, the set \(\mathcal {B}=\{\widetilde{H}^i \mid 1\le i \le q\}\) is returned.
This algorithm is illustrated in Fig.Â 17. Within the graph H a hyperpath is marked red. Branching is performed along this hyperpath using the hyperarc order \(\langle p(A),p(B),p(D),p(E),p(t) \rangle\). The resulting hypergraphs \(H^5, H^4, \ldots , H^1\) are also depicted. Thick hyperarcs are fixed, which results in the deletion of the gray, dotted hyperarcs. The red and dashed hyperarc in each graph is the hyperarc at which the deviation takes place, and thus, this hyperarc is also deleted.
The main algorithm KShortest, AlgorithmÂ 3, maintains a priority queue L of tuples of the form \((\widetilde{H}, \widetilde{\pi })\), where \(\widetilde{H}\) is a hypergraph representation of a set of sthyperpaths in H, as described above, and \(\widetilde{\pi }\) is the best of these according to W. In the priority queue, the key of a tuple is \(W(\widetilde{\pi })\). Initially L contains the tuple \((H,\pi _{st})\).
In each iteration, the smallest tuple of L, say \((H', \pi ')\), is extracted and \(\pi '\) is output as the next best hyperpath of H. Then \(H'\) is partitioned along \(\pi '\) using the backwards branching procedure BackBranch, and each new partition along with its optimal hyperpath is inserted into L (unless no hyperpath exists in the partition). The algorithm terminates when K hyperpaths have been output or if L is empty.
The correctness of the algorithm KShortest follows from the fact that it maintains the following invariant: At the end of iteration i, the i best hyperpaths \(\pi _1, \pi _2, \ldots , \pi _i\) have been output, and the hypergraphs of the tuples of L represent a partition of \(\mathcal {P}{\setminus } \{ \pi _1, \pi _2, \ldots , \pi _i\}\).
Algorithm ShortestPath in line 12 of AlgorithmÂ 3 computes the optimal hyperpath according toÂ W. In acyclic Bhypergraphs this can be done using dynamic programming in \(O(V+{{\mathrm{size}}}(H))\) timeÂ [35].
For acyclic hypergraphs, algorithm KShortest runs in \(O(KV(V+{{\mathrm{size}}}(H)))\) timeÂ [20]. As described earlier, for a \({{\mathrm{HoR}}}\) H we have \({{\mathrm{size}}}(H)\le 3E\), which means that when using the algorithm for synthesis planning the runtime is \(O(KV(V+E))\).
Example
The hypergraphÂ H of Fig.Â 17 is depicted again in Fig.Â 18a. There are four hyperpaths in this hyperpath, namely \(\pi _1, \pi _2, \pi _3\) and \(\pi _4\), depicted in Fig.Â 18b, e. We illustrate how the best three hyperpaths are computed by algorithm KShortest when assuming \(W(\pi _1)< W(\pi _2)< W(\pi _3)<W(\pi _4)\).
Initially, \(L=\{(H,\pi _1)\}\). The tuple is extracted, \(\pi _1\) is output as the optimal hyperpath of H, and branching is performed on H along \(\pi _1\). The branching is shown in Fig.Â 19 (\(\pi _1\) is red). This figure is identical to Fig.Â 17 except for added information on the set of hyperpaths in each hypergraph. For instance, \(H^5\) contains the hyperpaths \(\pi _2\) and \(\pi _4\). The optimal hyperpath is computed for each \(H^i\), and since \(H^1,H^2\) and \(H^4\) have no hyperpaths from s to t, \(L=\{(H^5,\pi _2),(H^3,\pi _3)\}\) by the beginning of iteration two.
In iteration two, the tuple \((H^5,\pi _2)\) is extracted since we assumed that \(W(\pi _2)<W(\pi _ 3)\). The hyperpath \(\pi _2\) is output as the second best hyperpath in H and branching is performed on \(H^5\) along \(\pi _2\). This is shown in Fig.Â 20 (\(\pi _2\) is red). The only hypergraph in which there is a hyperpath from s to t is \(H^{54}\). Hence, the tuple \((H^{54},\pi _4)\) is inserted into L which becomes \(L=\{ (H^3,\pi _3), (H^{54},\pi _4)\}\).
In iteration three, the tuple \((H^3,\pi _3)\) is extracted from L, \(\pi _3\) is output as the third best hyperpath of H and the algorithm terminates.
Appendix 3: Bond set based HoR construction
In this appendix, we consider the case of a HoR for which the sets R and S of DefinitionÂ 3 are defined by recursively breaking bonds in a given subsetÂ B of the bonds of the target in all possible ways, and present algorithmic details of how to do this efficiently.
A straightforward method would be to consider all the B! orders of fixing the bonds inÂ B, each of which gives a unarybinary tree, and then for each tree enforcing the requirement that no intermediate molecule is synthesized in more than one way, cf. Fig.Â 2. Enforcing that requirement (and creating the DAG of Fig.Â 3b) can be done as follows: for each intermediate molecule appearing more than once in vertices of the tree choose one of these vertices and change all pointers to the rest of these vertices to point to that chosen vertex. To create all possible synthesis plans, for each such intermediate molecule all choices should be considered. This should be done in a bottomup fashion, from smaller intermediate molecules to larger ones, in an ordering where moleculeÂ \(m_1\) is considered larger than moleculeÂ \(m_2\) if when seen as graphs \(m_1\) has more vertices than \(m_2\), or they have the same number of vertices and \(m_1\) has more edges than \(m_2\). Finally, R and S are set to the union of the reactions, respectively starting materials, of all of the synthesis plans created.
This process, however, would take \(\Omega (B!)\) time. It would also render pointless the use of the algorithm for finding the K optimal hyperpaths in the resulting hypergraph, since having considered each synthesis plan explicitly one could just as well have evaluated the cost of each in the process, while keeping track of the K best.
We now give an algorithm Expand\({{\mathrm{HoR}}}\) (see AlgorithmÂ 4) for constructing the \({{\mathrm{HoR}}}\) which under reasonable assumptions runs in \(O(V \cdot B \cdot t)\) time, where t is the size (number of vertices plus number of edges when seen as a graph) of the target moleculeÂ t. The algorithm explores the possible synthesis plans in a topdown manner, starting with the target molecule, and recursively breaking bonds fromÂ B. To avoid exploring the synthesis of a given intermediate molecule more than once, it checks if an intermediate molecule has already been explored before recursing on it.
Each intermediate moleculeÂ m is represented as a labeled (standard) graph, with the edges insideÂ m corresponding to bonds inÂ B being marked. Such a graph can be traversed in O(m) time, and for each bond inÂ B, the intermediate molecules produced by removing this bond can be found in O(m) time, as they are the connected components of the resulting graph.
A molecule can also be represented by a unique string identifierÂ [36, 37] for molecules/labeled graphs. In the algorithm we use two types of unique string identifiers for intermediate molecules: IDbond(m) for the graph of the moleculeÂ m including the marking on edges of the bonds fromÂ B, and ID(m) where these markings are disregarded. The reason is that it is possible for a bond setÂ B to specify, in different locations of the target molecule, the same intermediate molecule with different internal sets of bond set edges. In any synthesis plan, if this intermediate molecule appears, it should be produced in only one way.^{Footnote 5} However, for considering all possible synthesis plans, all the ways of synthesizing this intermediate molecule should be considered. In other words, a intermediate molecule appearing in several places should be represented by a single vertexÂ v in the \({{\mathrm{HoR}}}\), but its synthesis should be explored for all the occurring subsets of bond set edges inside it. Therefore, the check in the algorithm for further exploration of an intermediate moleculeÂ m is based on whether IDbond(m) has been seen before, but the vertices of the resulting \({{\mathrm{HoR}}}\) hypergraph are based on the ID(m) values.
A hyperarc \(e = (v, v_1, v_2)\) is a triple of string identifiers of type ID(m), with v representing the output molecule, and \(v_1\) and \(v_2\) representing the input molecules of the reaction modeled byÂ e. When \(T(e) = 1\), \(v_2\) is the empty string. The identifiers of type IDbond(m) seen so far, as well as the generated edges, are kept in hash tables \(V'\) and E, respectively. At the end of the algorithm, V can be generated as all vertices appearing in hyperarcs inÂ E. The \({{\mathrm{HoR}}}\) is then the hypergraph (V,Â E).
The algorithm Expand\({{\mathrm{HoR}}}\) maintains the invariant that at the time of call Expand\({{\mathrm{HoR}}}\)(m), IDbond(m) has not been explored before. The very first call has m equal to the target molecule. The sets \(V'\) and E are global variables, each initialized to the empty set. When inserting into a hash table, it is assumed that nothing happens if the value is already present. The value S is just an identifier for the dummy vertexÂ s of the \({{\mathrm{HoR}}}\).
Each vertexÂ v in the resulting hypergraph may represent an intermediate molecule on which the algorithm is called several times, with different values of IDbond(m), but same value of ID(m). For each value of IDbond(m), there can only be one call, due to the maintenance ofÂ \(V'\). If we assume that these values represents occurrences of the intermediate molecule at nonoverlapping places in the target molecule, their combined number of bond set edges is bounded by B. Under this assumption, each recursive call from an vertexÂ v (with id ID(m)) is induced by a different bond set edge inÂ t, so we can only have B recursive calls in total fromÂ v, hence only \(O(V \cdot B)\) recursive calls in total in the algorithm. For each bond edge, the connected components resulting from its removal can be found in O(t) time. Hence, the algorithm uses \(O(V \cdot B \cdot t)\) time, if the time for finding string identifiers is assumed to be also O(t). The time for finding a unique string identifier is in the worst case actually exponential in the size of the intermediate molecule (consistent with the fact that finding unique identifiers solves the graphisomorphism problem, which is not known to be solvable in polynomial time), but empirically, reallife molecules do not represent worst case instances, since algorithms for this work very fast in practiceÂ [37]. Note that a similar assumption on the time for solving the graphisomorphism on reallife molecules applies to the straightforward algorithm described above, since it also needs to check whether intermediate molecules are the same. Hashing operations takes O(1) time, but only in the expected sense, hence the bound for the algorithm stated above is expected time.
We note that V is always at most \(O(2^{B})\), since each \(v \in V\) can be specified by the bonds inÂ B which are fixed in the subtree of v in some synthesis plan. Despite being exponential in B, this is much better than \(\Omega (B!)\). For certain target molecules, V can be bound even betterâ€”for instance, for linear molecules V is \(O(B^2)\).
Appendix 4: Total weight of starting materials
We here show the connection between the two variants of the quality measure total weight of starting materials (\({{\mathrm{TW}}}\)) given by HendricksonÂ [8] and by SmithÂ [9].
Recall the definition from â€śSynthesis planning basicsâ€ť section of Smithâ€™s version (here slightly rephrased in order to prepare for the inductive proof of PropositionÂ 1 below): Let \(T_t\) be the unarybinary tree representation of a synthesis plan for a target molecule t, let \(P_{ti}\) be the path inÂ \(T_t\) from t to leafÂ i, and for an edge \(e=(u,v)\) inÂ \(T_t\) let \(r_e\) be the weight in grams of moleculeÂ v needed to create one gram of u. Then SmithÂ [9] calculates the total weight of starting materials needed to create one gram of target t as follows.^{Footnote 6}
HendricksonÂ [8] calculates the total weight of starting materials needed to produce one molecule of the target as follows, whereÂ i again denotes a leaf inÂ \(T_t\).
In this formula, Hendrickson assumes the same yield (in the usual chemical meaning, percentage of input material that becomes output material) y for all reactions and sets \(x=1/y\). The weight of the molecule in vertexÂ v is denotedÂ \(w_v\). Clearly, for a binary vertex v with children \(v_1,v_2\) we have \(w_v=w_{v_1}+w_{v_2}\) and for a unary vertex v with child \(v_1\) we have \(w_{v}=w_{v_1}\).
The following proposition shows that givenÂ x in Hendricksonâ€™s definition, we can set the retro yields in Smithâ€™s definition such that the two measures have proportional values. Hence, Smithâ€™s definition is a generalization of Hendricksonâ€™s.
Proposition 1
Let \(r_{(u,v)} = \frac{w_v}{w_u} x\) for all edges (u,Â v) in the unarybinary tree \(T_t\) representing a synthesis plan for t. Then \(S_t w_{t} = H_t\).
Proof
We prove this by induction over the height of the unarybinary tree.
Consider the base case where the height \(h=0\): the unarybinary tree consists of just a target t. Then \(S_w=1\) and \(H_w=w_t\) so \(S_w w_t = H_w\).
For the inductive step, let \(h > 0\) and assume \(S_{t'} w_{t'} = H_{t'}\) for any target \(t'\) with a unarybinary tree of height \(k<h\). There are two cases: (i.) t is the product of a cyclization and has one child, or (ii.) t is the product of an affixation and has two children.
Case (ii): Let the children of t be v,Â u. We have
From \(S_t= r_{(t,v)}S_{v}+r_{(t,u)}S_{u}\) and \(H_t= x(H_{v}+ H_u)\) we get
Case (i) is similar, only simpler. \(\square\)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Fagerberg, R., Flamm, C., Kianian, R. et al. Finding the K best synthesis plans. J Cheminform 10, 19 (2018). https://doi.org/10.1186/s133210180273z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s133210180273z