arXiv is now an independent nonprofit! Learn more
License: arXiv.org perpetual non-exclusive license
arXiv:1809.00585v1 [cs.DS] 03 Sep 2018

The Complexity Landscape of Decompositional Parameters for ILPJournal: Artificial Intelligence

Robert Ganian Email: rganian@gmail.com Corresponding author: Corresponding authors Address: Algorithms and Complexity Group, TU Wien, Favoritenstrasse 9-11, 1040 Wien, Austria    Sebastian Ordyniak Email: sordyniak@gmail.com Address: Algorithms and Complexity Group, TU Wien, Favoritenstrasse 9-11, 1040 Wien, Austria
Abstract

Integer Linear Programming (ILP) can be seen as the archetypical problem for NP-complete optimization problems, and a wide range of problems in artificial intelligence are solved in practice via a translation to ILP. Despite its huge range of applications, only few tractable fragments of ILP are known, probably the most prominent of which is based on the notion of total unimodularity. Using entirely different techniques, we identify new tractable fragments of ILP by studying structural parameterizations of the constraint matrix within the framework of parameterized complexity.

In particular, we show that ILP is fixed-parameter tractable when parameterized by the treedepth of the constraint matrix and the maximum absolute value of any coefficient occurring in the ILP instance. Together with matching hardness results for the more general parameter treewidth, we give an overview of the complexity of ILP w.r.t. decompositional parameters defined on the constraint matrix.

Keywords: 
Integer Linear Programming, treewidth, treedepth, (Parameterized) complexity

1 Introduction

Integer Linear Programming (ILP) is among the most successful and general paradigms for solving computationally intractable optimization problems in computer science. In particular, a wide variety of problems in artificial intelligence are efficiently solved in practice via a translation into an Integer Linear Program, including problems from areas such as process scheduling [10], planning [31, 32], vehicle routing [30], packing [23], and network hub location [1]. In its most general form ILP can be formalized as follows:

Integer Linear Program
Input: A matrix Am×nA\in\mathbb{Z}^{m\times n} and two vectors bmb\in\mathbb{Z}^{m} and sns\in\mathbb{Z}^{n}. Question: Maximize sTxs^{T}x for every xnx\in\mathbb{Z}^{n} with AxbAx\leq b.

Closely related to ILP is the ILP-feasibility problem, where given AA and bb as above, the problem is to decide whether there is an xnx\in\mathbb{Z}^{n} such that AxbAx\leq b. The decision version of ILP, ILP-feasibility and various other highly restricted variants are well-known to be NP-complete [28].

Despite the importance of the problem, an understanding of the influence of structural restrictions on the complexity of ILP is still in its infancy. This is in stark contrast to another well-known and general paradigm for the solution of problems in Computer Science, the Satisfiability problem (SAT). There, the parameterized complexity framework [7] has yielded deep results capturing the tractability and intractability of SAT with respect to a plethora of structural restrictions. In the context of SAT, one often considers structural restrictions on a graphical representation of the formula (such as the primal graph), and the aim is to design efficient fixed-parameter algorithms for SAT, i.e., algorithms running in time 𝒪(f(k)n𝒪(1)){\mathcal{O}}(f(k)n^{{\mathcal{O}}(1)}) where kk is the value of the considered structural parameter for the given SAT instance and nn is its input size. It is known that SAT is fixed-parameter tractable w.r.t. a variety of structural parameters, including the prominent parameters treewidth [29] but also more specialized parameters [9, 13, 14].

Our contribution

In this work, we carry out a similar line of research for ILP by studying the parameterized complexity of ILP w.r.t. various structural parameterizations. In particular, we consider parameterizations of the primal graph of the ILP instance, i.e., the undirected graph whose vertex set is the set of variables of the ILP instance and whose edges represent the occurrence of two variables in a common expression. We obtain a complete picture of the parameterized complexity of ILP w.r.t. well-known decompositional parameters of the primal graph, specifically treedepth, treewidth, and cliquewidth; our results are summarized in Table 1.

\ell without \ell
TD FPT (Thm 6) paraNP-h (Thm 12)
TW/CW paraNP-h (Thm 13) paraNP-h (Thm 13)
None paraNP-h (Obs 1) n.a.
Table 1: The complexity landscape of ILP obtained in this paper. The table shows the parameterized complexity of ILP parameterized by the treedepth (TD), treewidth (TW), or cliquewidth (CW) of the primal graph with (second column “\ell”) and without (third column “without \ell”) the additional parameterization by the maximum absolute value \ell of any coefficient in AA or bb.

Our main algorithmic result (Theorem 6) shows that ILP is fixed-parameter tractable parameterized by the treedepth of the primal graph and the maximum absolute value \ell of any coefficient occurring in AA or bb. Together with the classical results for totally unimodular matrices [27, Section 13.2.] and fixed number of variables [22], which use entirely different techniques, our result is one of the few tractability results for ILP without additional restrictions. We note that the presented algorithm is primarily of theoretical interest; the intent here is to classify the complexity of ILP by providing runtime guarantees, not to compete with state-of-the-art ILP solvers.

We complement our algorithmic results with matching lower bounds, provided in terms of paraNP-hardness results (see the Preliminaries); an overview of the obtained results is provided in Table 1. Namely, we show that already ILP-feasibility is unlikely to be fixed-parameter tractable when parameterized by treedepth (whereas the case of parameterizing by only \ell is known to be hard); in fact, our results also exclude algorithms running in time (n+m)f(k)(n+m)^{f(k)}, where kk is the parameter. Moreover, the hardness results provided here also hold in the strong sense, i.e., even for ILP instances whose size is bounded by a polynomial of nn and mm; it is worth noting that this requires a more careful approach than what would suffice for weak paraNP-hardness.

One might be tempted to think that, as is the case for SAT and numerous other problems, the fixed-parameter tractability result for treedepth carries over to the more general structural parameter treewidth. We show that this is not the case for ILP. Along with recent results for the Mixed Chinese Postman Problem [18], this is only the second known case of a natural problem where using treedepth instead of treewidth actually “helps” in terms of fixed parameter tractability. In fact, we show that already ILP-feasibility remains NP-hard for ILP instances of treewidth at most two and whose maximum coefficient is at most one. Observe that this also implies the same intractability results for the more general parameter clique-width [2].

Related Work

We are not the first to consider decompositional parameterizations of the primal graph for ILP. However, previous results in this area required either implicit or explicit bounds on the domain values of variables together with further restrictions on the coefficients. In particular, for the case of non-negative ILP instances, i.e., ILP instances where all coefficients as well as all variable domains are assumed to be non-negative, ILP is known to be fixed-parameter tractable parameterized by the branchwidth, a decompositional parameter closely related to treewidth, of the primal graph and the maximum value BB of any coefficient in the constraint vector bb [3]. Note that BB also bounds the maximum domain value of any variable in the case of non-negative ILP instances. A more recent result by Jansen and Kratsch [20] showed that ILP is fixed-parameter tractable parameterized by the treewidth of the primal graph and the maximum absolute domain value of any variable. Hence in both cases the maximum absolute domain value of any variable is bounded by the considered parameters, whereas the results presented in this paper do not require any bound on the domain values of variables.

Furthermore, a series of tractability results for ILP based on restrictions on the constraint matrix AA, instead of restrictions on the primal graph, have been obtained [5, 19, 26]. These results apply whenever the constraint matrix AA can be written as an arbitrary large product of matrices of bounded size and are usually referred to as nn-fold ILP, two-stage stochastic ILP, and 4-block nn-fold ILP.

2 Preliminaries

We will use standard graph terminology, see for instance [6]. A graph GG is a tuple (V,E)(V,E), where VV or V(G)V(G) is the vertex set and EE or E(G)E(G) is the edge set. A graph HH is a subgraph of a graph GG, denoted HGH\subseteq G, if HH can be obtained by deleting vertices and edges from GG. All our graphs are simple and loopless.

A path from vertex v1v_{1} to vertex vjv_{j} in GG is a sequence of distinct vertices v1,,vjv_{1},\dots,v_{j} such that for each 1i<j1\leq i<j, {vi,vi+1}E(G)\{v_{i},v_{i+1}\}\in E(G). A tree is a graph in which, for any two vertices v,wGv,w\in G, there is precisely one unique path from vv to ww; a tree is rooted if it contains a specially designated vertex rr, the root. Given a vertex vv in a tree GG with root rr, the parent of vv is the unique vertex ww with the property that {v,w}\{v,w\} is the first edge on the path from vv to rr.

2.1 Integer Linear Programming

For our purposes, it will be useful to view an ILP instance as a set of linear inequalities rather than using the constraint matrix. Formally, let an ILP instance II be a tuple (,η)({\cal F},\eta) where {\cal F} is a set of linear inequalities over variables X={x1,,xn}X=\{x_{1},\dots,x_{n}\} and η\eta is a linear function over XX of the form η(X)=s1x1++snxn\eta(X)=s_{1}x_{1}+\dots+s_{n}x_{n}. Each inequality AA\in{\cal F} ranges over variables var(A)\text{var}(A) is said to have arity |var(A)|=l|\text{var}(A)|=l and is assumed to be of the form cA,1xA,1+cA,2xA,2++cA,lxA,lbAc_{A,1}x_{A,1}+c_{A,2}x_{A,2}+\dots+c_{A,l}x_{A,l}\leq b_{A}; we also define var(I)=X\text{var}(I)=X. We say that two constraints are equal if they range over the same variables with the same coefficients and have the same right-hand side.

For a set of variables YY, let (Y){\cal F}(Y) denote the subset of {\cal F} containing all inequalities AA\in{\cal F} such that Yvar(A)Y\cap\text{var}(A)\neq\emptyset. We will generally use the term coefficients to refer to numbers that occur in the inequalities in {\cal F}. In some cases, we will be dealing with certain selected “named” variables which will not be marked with subscripts to improve readability (e.g., aa); there, we may use sas_{a} to denote the coefficient of aa in η\eta, i.e., sas_{a} is shorthand for sjs_{j} where a=xja=x_{j}.

An assignment α\alpha is a mapping from XX to \mathbb{Z}. For an assignment α\alpha and an inequality AA of arity ll, we denote by A(α)A(\alpha) the left-side value of AA obtained by applying α\alpha, i.e., A(α)=cA,1α(xA,1)+cA,2α(xA,2)++cA,lα(xA,l)A(\alpha)=c_{A,1}\alpha(x_{A,1})+c_{A,2}\alpha(x_{A,2})+\dots+c_{A,l}\alpha(x_{A,l}). Similarly, we let η(α)\eta(\alpha) denote the value of the linear function η\eta after applying α\alpha.

An assignment α\alpha is called feasible if it satisfies every AA\in{\cal F}, i.e., if A(α)bAA(\alpha)\leq b_{A} for each AA\in{\cal F}. Furthermore, α\alpha is called a solution if the value of η(α)\eta(\alpha) is maximized over all feasible assignments; observe that the existence of a feasible assignment does not guarantee the existence of a solution (there may exist an infinite sequence of feasible assignments α\alpha with increasing values of η(α)\eta(\alpha)). Given an instance II, the task in the ILP problem is to compute a solution for II if one exists, and otherwise to decide whether there exists a feasible assignment. On the other hand, the ILP-feasibility problem asks whether a given instance II admits a feasible assignment (here, we may assume without loss of generality that all coefficients in η\eta are equal to 00).

Given an ILP instance I=(,η)I=({\cal F},\eta), the primal graph GIG_{I} of II is the graph whose vertex set is the set XX of variables in II, and two vertices a,ba,b are adjacent iff either there exists some AA\in{\cal F} containing both aa and bb or a,ba,b both occur in η\eta with non-zero coefficients.

2.2 Parameterized Complexity

In parameterized algorithmics [4, 11, 25, 7] the runtime of an algorithm is studied with respect to a parameter kk\in\mathbb{N} and input size nn. The basic idea is to find a parameter that describes the structure of the instance such that the combinatorial explosion can be confined to this parameter. In this respect, the most favorable complexity class is FPT (fixed-parameter tractable) which contains all problems that can be decided by an algorithm running in time f(k)n𝒪(1)f(k)\cdot n^{{\mathcal{O}}(1)}, where ff is a computable function. Algorithms with this running time are called fpt-algorithms.

To obtain our lower bounds, we will need the notion of a parameterized reduction and the complexity class paraNP [7]. Since we obtain all our lower bounds already for ILP-feasibility, we only need to consider these notions for decision problems; formally, a parameterized decision problem is a subset of Σ×\Sigma^{*}\times\mathbb{N}, where Σ\Sigma is the input alphabet.

Let L1L_{1} and L2L_{2} be parameterized decision problems, with L1Σ1×L_{1}\subseteq\Sigma_{1}^{*}\times\mathbb{N} and L2Σ2×L_{2}\subseteq\Sigma_{2}^{*}\times\mathbb{N}. A parameterized reduction (or fpt-reduction) from L1L_{1} to L2L_{2} is a mapping P:Σ1×Σ2×P:\Sigma_{1}^{*}\times\mathbb{N}\rightarrow\Sigma_{2}^{*}\times\mathbb{N} such that:

  1. 1.

    (x,k)L1(x,k)\in L_{1} if and only if P(x,k)L2P(x,k)\in L_{2};

  2. 2.

    the mapping can be computed by an fpt-algorithm with respect to parameter kk;

  3. 3.

    there is a computable function gg such that kg(k)k^{\prime}\leq g(k), where (x,k)=P(x,k)(x^{\prime},k^{\prime})=P(x,k).

There is a variety of classes capturing parameterized intractability. For our results, we require only the class paraNP, which is defined as the class of problems that are solvable by a nondeterministic Turing-machine in fpt-time. We will make use of the characterization of paraNP-hardness given by Flum and Grohe [11], Theorem 2.14: any parameterized (decision) problem that remains NP-hard when the parameter is set to some constant is paraNP-hard. Showing paraNP-hardness for a problem rules out the existence of an fpt-algorithm under the assumption that PNP{\mbox{{{P}}}}\neq{\mbox{{{NP}}}}. In fact, it even allows us to rule out algorithms running in time nf(k)n^{f(k)} for any function ff (these are sometimes called XP algorithms).

For our algorithms, we will use the following result as a subroutine. Note that this is a streamlined version of the original statement of the theorem, as used in the area of parameterized algorithms [8, 15].

Theorem 1 ([22, 21, 12]).

An ILP instance I=(,η)I=({\cal F},\eta) can be solved in time 𝒪(p2.5p+o(p)|I|)\mathcal{O}(p^{2.5p+o(p)}\cdot|I|), where p=|var(I)|p=|\text{var}(I)|.

2.3 Treewidth and Treedepth

Treewidth is the most prominent structural parameter and has been extensively studied in a number of fields. In order to define treewidth, we begin with the definition of its associated decomposition. A tree-decomposition 𝒯\mathcal{T} of a graph G=(V,E)G=(V,E) is a pair (T,χ)(T,\chi), where TT is a tree and χ\chi is a function that assigns each tree node tt a set χ(t)V\chi(t)\subseteq V of vertices such that the following conditions hold:

  • (P1)

    For every vertex uVu\in V, there is a tree node tt such that uχ(t)u\in\chi(t).

  • (P2)

    For every edge {u,v}E(G)\{u,v\}\in E(G) there is a tree node tt such that u,vχ(t)u,v\in\chi(t).

  • (P3)

    For every vertex vV(G)v\in V(G), the set of tree nodes tt with vχ(t)v\in\chi(t) forms a subtree of TT.

The sets χ(t)\chi(t) are called bags of the decomposition 𝒯\mathcal{T} and χ(t)\chi(t) is the bag associated with the tree node tt. The width of a tree-decomposition (T,χ)(T,\chi) is the size of a largest bag minus 11. A tree-decomposition of minimum width is called optimal. The treewidth of a graph GG, denoted by tw(G)\textup{tw}(G), is the width of an optimal tree decomposition of GG.

Another important notion that we make use of extensively is that of treedepth. Treedepth is a structural parameter closely related to treewidth, and the structure of graphs of bounded treedepth is well understood [24]. A useful way of thinking about graphs of bounded treedepth is that they are (sparse) graphs with no long paths.

We formalize a few notions needed to define treedepth. A rooted forest is a disjoint union of rooted trees. For a vertex xx in a tree TT of a rooted forest, the height (or depth) of xx in the forest is the number of vertices in the path from the root of TT to xx. The height of a rooted forest is the maximum height of a vertex of the forest.

Definition 2 (Treedepth).

Let the closure of a rooted forest \cal F be the graph clos()=(Vc,Ec)\text{clos}({\cal F})=(V_{c},E_{c}) with the vertex set Vc=TV(T)V_{c}=\bigcup_{T\in\cal F}V(T) and the edge set Ec={xy:x is an ancestor of y in some T}E_{c}=\{xy\colon\text{$x$ is an ancestor of $y$ in some $T\in\cal F$}\}. A treedepth decomposition of a graph GG is a rooted forest \cal F such that Gclos()G\subseteq\text{clos}(\cal F). The treedepth td(G)td(G) of a graph GG is the minimum height of any treedepth decomposition of GG.

We will later use TxT_{x} to denote the vertex set of the subtree of TT rooted at a vertex xx of TT. Similarly to treewidth, it is possible to determine the treedepth of a graph in FPT time.

Proposition 3 ([24]).

Given a graph GG with nn nodes and a constant ww, it is possible to decide whether GG has treedepth at most ww, and if so, to compute an optimal treedepth decomposition of GG in time 𝒪(n){\mathcal{O}}(n).

The following alternative (equivalent) characterization of treedepth will be useful later for ascertaining the exact treedepth in our reduction (specifically in Lemma 12).

Proposition 4 ([24]).

Let GiG_{i} be the connected components of GG. Then

td(G)={1,if |V(G)|=1;1+minvV(G)td(Gv),if G is connected and |V(G)|>1;maxitd(Gi),otherwise.td(G)=\begin{cases}1,&\text{if }|V(G)|=1;\\ 1+\min_{v\in V(G)}td(G-v),&\text{if $G$ is connected and }|V(G)|>1;\\ \max_{i}td(G_{i}),&\text{otherwise.}\end{cases}

We conclude with a few useful facts about treedepth.

Proposition 5 ([24]).
  1. 1.

    If a graph GG has no path of length dd, then td(G)dtd(G)\leq d.

  2. 2.

    If td(G)dtd(G)\leq d, then GG has no path of length 2d2^{d}.

  3. 3.

    tw(G)td(G)tw(G)\leq td(G).

  4. 4.

    If td(G)dtd(G)\leq d, then td(G)d+1td(G^{\prime})\leq d+1 for any graph GG^{\prime} obtained by adding one vertex into GG.

Within this manuscript, for an ILP instance II we will use treewidth (treedepth) of II as shorthand for the treewidth (treedepth) of the primal graph GIG_{I} of II.

3 Exploiting Treedepth to Solve ILP

Our goal in this section is to show that ILP is fixed parameter tractable when parameterized by the treedepth of the primal graph and the maximum coefficient in any constraint. We begin by formalizing our parameters. Given an ILP instance II, let td(I)td(I) be the treedepth of GIG_{I} and let (I)\ell(I) be the maximum absolute coefficient which occurs in any inequality in II; to be more precise, (I)=max{|cA,j|,|bA|:A,j}\ell(I)=\max\{\,|c_{A,j}|,|b_{A}|\;{:}\;A\in{\cal F},j\in{\mathbb{N}}\,\}. When the instance II is clear from the context, we will simply write \ell and k=td(I)k=td(I) for brevity. We will now state our main algorithmic result of this section.

Theorem 6.

ILP is fixed-parameter tractable parameterized by \ell and kk

The main idea behind our fixed-parameter algorithm for ILP is to show that we can reduce the instance into an “equivalent instance” such that the number of variables of the reduced instance can be bounded by our parameters \ell and kk. We then apply Theorem 1 to solve the reduced instance.

For the following considerations, we fix an ILP instance I=(,η)I=({\cal F},\eta) of size nn along with a treedepth decomposition TT of GIG_{I} with depth kk. Given a variable set YY, the operation of omitting consists of deleting all inequalities containing at least one variable in YY and all variables in YY; formally, omitting YY from II results in the instance I=(,η)I^{\prime}=({\cal F}^{\prime},\eta^{\prime}) where =(Y){\cal F}^{\prime}={\cal F}\setminus{\cal F}(Y) and η\eta^{\prime} is obtained by removing all variables in YY from η\eta.

The following notion of equivalence will be crucial for the proof of Theorem 6. Let x,yx,y be two variables that share a common parent in TT, and recall that TxT_{x} (TyT_{y}) denotes the vertex set of the subtree of TT rooted at xx (yy). We say that xx are yy are equivalent, denoted xyx\sim y, if there exists a bijective function δx,y:TxTy\delta_{x,y}:T_{x}\rightarrow T_{y} (called the renaming function) such that δx,y((Tx))=(Ty)\delta_{x,y}({\cal F}(T_{x}))={\cal F}(T_{y}); here δx,y((Tx))\delta_{x,y}({\cal F}(T_{x})) denotes the set of inequalities in (Tx){\cal F}(T_{x}) after the application of δx,y\delta_{x,y} on each variable in TxT_{x}. In other words, xyx\sim y means that there exists a way of “renaming” the variables in TyT_{y} so that (Ty){\cal F}(T_{y}) becomes (Tx){\cal F}(T_{x}).

It is easy to verify that \sim is indeed an equivalence relation. Intuitively, the following lemma shows that if xyx\sim y for two variables xx and yy of II, then (up to renaming) the set of all feasible assignments of the variables in TxT_{x} is equal to the set of all feasible assignments of the variables in TyT_{y}; it will be useful to recall the meaning of sas_{a} from Subsection 2.1.

Lemma 7.

Let x,yx,y be two variables of II such that xyx\sim y and sa=0s_{a}=0 for each aTxTya\in T_{x}\cup T_{y}. Let I=(,η)I^{\prime}=({\cal F}^{\prime},\eta^{\prime}) be the instance obtained from II by omitting TyT_{y}. Then there exists a solution α\alpha of var(I)\text{var}(I) of value w=η(α)w=\eta(\alpha) if and only if there exists a solution α\alpha^{\prime} of var(I)\text{var}(I^{\prime}) of value w=η(α)w=\eta^{\prime}(\alpha^{\prime}). Moreover, a solution α\alpha can be computed from any solution α\alpha^{\prime} in linear time if the renaming function δx,y\delta_{x,y} is known.

Proof.

Let α\alpha be a solution of var(I)\text{var}(I) of value w=η(α)w=\eta(\alpha). Since {\cal F}^{\prime}\subseteq{\cal F}, it follows that setting α\alpha^{\prime} to be a restriction of α\alpha to var(I)Ty\text{var}(I)\setminus T_{y} satisfies every inequality in {\cal F}^{\prime}. Since variables in TyT_{y} do not contribute to η\eta, it also follows that η(α)=η(α)\eta(\alpha)=\eta(\alpha^{\prime}).

On the other hand, let α\alpha^{\prime} be a solution of var(I)\text{var}(I^{\prime}) of value w=η(α)w=\eta^{\prime}(\alpha^{\prime}). Consider the assignment α\alpha obtained by extending α\alpha^{\prime} to TyT_{y} by reusing the assignments of TxT_{x} on TyT_{y}. Formally, for each zTyz\in T_{y} we set α(z)=α(δx,y1(z))\alpha(z)=\alpha^{\prime}(\delta^{-1}_{x,y}(z)) and for all other variables wvar(I)w\in\text{var}(I^{\prime}) we set α(w)=α(w)\alpha(w)=\alpha^{\prime}(w). By assumption, α\alpha and α\alpha^{\prime} must assign the same values to any variable ww such that sw0s_{w}\neq 0, and hence η(α)=η(α)\eta(\alpha)=\eta(\alpha^{\prime}). To argue feasibility, first observe that any AA\in{\cal F}^{\prime} must be satisfied by α\alpha since α\alpha and α\alpha^{\prime} only differ on variables which do not occur in II^{\prime}. Moreover, by definition of \sim for each A=(Ty)A\in{\cal F}\setminus{\cal F}^{\prime}={\cal F}(T_{y}) there exists an inequality AA^{\prime}\in{\cal F}^{\prime} such that δx,y(A)=A\delta_{x,y}(A^{\prime})=A. In particular, this implies that A(α)=A(α)=A(α)A(\alpha)=A^{\prime}(\alpha)=A^{\prime}(\alpha^{\prime}), and since A(α)bA=bAA^{\prime}(\alpha^{\prime})\leq b_{A^{\prime}}=b_{A} we conclude that A(α)bAA(\alpha)\leq b_{A}. Consequently, α\alpha satisfies AA.

The final claim of the lemma follows from the construction of α\alpha described above. ∎

In the following let zz be a variable of II at depth kik-i in TT for every ii with 1i<k1\leq i<k and let ZZ be the set of all children of zz in TT. Moreover, let mm be the maximum size of any subtree rooted at a child of zz in TT, i.e., m:=maxzZ|Tz|m:=\max_{z^{\prime}\in Z}|T_{z^{\prime}}|. We will show next that the number of equivalence classes among the children of zz can be bounded by the function #C(,k,i,m):=2(2+1)k+1mi\textup{\#C}(\ell,k,i,m):=2^{(2\ell+1)^{k+1}\cdot m^{i}}. Observe that this bound depends only on \ell, kk, mm, and ii and not on the size of II.

Lemma 8.

The equivalence relation \sim has at most #C(,k,i,m)\textup{\#C}(\ell,k,i,m) equivalence classes over ZZ.

Proof.

Consider an element aZa\in Z. By construction of GIG_{I}, each inequality A(Ta)A\in{\cal F}(T_{a}) only contains at most kik-i variables outside of TaT_{a} (specifically, the ancestors of aa) and at most ii variables in TaT_{a}. Furthermore, bAb_{A} and each coefficient of a variable in AA is an integer whose absolute value does not exceed \ell. From this it follows that there exists a finite number of inequalities which can occur in (Ta){\cal F}(T_{a}). Specifically, the number of distinct combinations of coefficients for all the variables in AA and for bAb_{A} is (2+1)k+1(2\ell+1)^{k+1}, and the number of distinct choices of variables in var(A)Ta\text{var}(A)\cap T_{a} is upper-bounded by (mi){m\choose i}, and so we arrive at |(Ta)|(2+1)k+1(mi)(2+1)k+1mi|{\cal F}(T_{a})|\leq(2\ell+1)^{k+1}\cdot{m\choose i}\leq(2\ell+1)^{k+1}\cdot m^{i}.

Consequently, the set of inequalities for each child yZy\in Z of zz has bounded cardinality. We will use this to bound the number of equivalence classes in #C(,k,i,m)\textup{\#C}(\ell,k,i,m) by observing that two elements are equivalent if and only if they occur in precisely the same sets of inequalities (up to renaming). To formalize this intuition, we need a formal way of canonically renaming all variables in the individual subtrees rooted in ZZ; without renaming, each (Ty){\cal F}(T_{y}) would span a distinct set of variables and hence it would not be possible to bound the set of all such inequalities. So, for each yy let δy,x0\delta_{y,x_{0}} be a bijective renaming function which renames all of the variables in TyT_{y} to the variable set {x01,x02,,x0|Ty|}\{x_{0}^{1},x_{0}^{2},\dots,x_{0}^{|T_{y}|}\} (in an arbitrary way). Now we can formally define Γz={(Tx0):δy,x0((Ty)),yZ}\Gamma_{z}=\{\,{\cal F}(T_{x_{0}})\;{:}\;\delta_{y,x_{0}}({\cal F}(T_{y})),y\in Z\,\}, and observe that Γz\Gamma_{z} has cardinality at most 2(2+1)k+1mi=#C(,k,i,m)2^{(2\ell+1)^{k+1}\cdot m^{i}}=\textup{\#C}(\ell,k,i,m). To conclude the proof, recall that if two variables a,ba,b satisfy (Ta)=δb,a((Tb)){\cal F}(T_{a})=\delta_{b,a}({\cal F}(T_{b})) for a bijective renaming function δb,a\delta_{b,a}, then bab\sim a. Hence, the absolute bound on the cardinality of Γz\Gamma_{z} implies that \sim has at most #C(,k,i,m)\textup{\#C}(\ell,k,i,m) equivalence classes over ZZ. ∎

It follows from the above Lemma that if zz has more than #C(,k,i,m)\textup{\#C}(\ell,k,i,m) children, then two of those must be equivalent. The next lemma shows that it is also possible to find such a pair of equivalent children efficiently.

Lemma 9.

Given a subset ZZ^{\prime} of ZZ with |Z|=#C(,k,i,m)+1|Z^{\prime}|=\textup{\#C}(\ell,k,i,m)+1, then in time 𝒪(#C(,k,i,m)2m!m)\mathcal{O}(\textup{\#C}(\ell,k,i,m)^{2}\cdot m!m) one can find two children xx and yy of ZZ such that xyx\sim y together with a renaming function δx,y\delta_{x,y} which certifies this.

Proof.

Consider the following algorithm 𝔸\mathbb{A}. First, 𝔸\mathbb{A} computes a subset ZZ^{\prime} consisting of exactly (arbitrarily chosen) #C(,k,i,m)+1\textup{\#C}(\ell,k,i,m)+1 children of ZZ. Then 𝔸\mathbb{A} branches over all distinct pairs x,yZx,y\in Z^{\prime} in time at most 𝒪(#C(,k,i,m)2)\mathcal{O}(\textup{\#C}(\ell,k,i,m)^{2}). Second, 𝔸\mathbb{A} branches over all of the at most m!m! bijective renaming functions δx,y\delta_{x,y}. Third, 𝔸\mathbb{A} computes δx,y((Tx))\delta_{x,y}({\cal F}(T_{x})) and tests whether it is equal to (Ty){\cal F}(T_{y}) (which takes at most 𝒪(m)\mathcal{O}(m) time); if this is the case, then 𝔸\mathbb{A} terminates and outputs x,yx,y and δx,y\delta_{x,y}.

We argue correctness. By Lemma 8 and due to the cardinality of ZZ^{\prime}, there must exist x,yZx,y\in Z^{\prime} such that xyx\sim y. In particular, there must exist a renaming function δx,y\delta_{x,y} such that δx,y((Tx))=(Ty)\delta_{x,y}({\cal F}(T_{x}))={\cal F}(T_{y}). But then 𝔸\mathbb{A} is guaranteed to find such x,y,δx,yx,y,\delta_{x,y} since it performs an exhaustive search. ∎

Combining Lemma 7 and Lemma 9, we arrive at the following corollary.

Corollary 10.

If |Z|>#C(,k,i,m)+1|Z|>\textup{\#C}(\ell,k,i,m)+1, then in time 𝒪(#C(,k,i,m)2m!m)\mathcal{O}(\textup{\#C}(\ell,k,i,m)^{2}\cdot m!m) one can compute a subinstance I=(,η)I^{\prime}=({\cal F}^{\prime},\eta) of II with strictly less variables and the following property: there exists a solution α\alpha of II of value w=η(α)w=\eta(\alpha) if and only if there exists a solution α\alpha^{\prime} of II^{\prime} of value ww. Moreover, a solution α\alpha can be computed from any solution α\alpha^{\prime} in linear time.

Proof.

In order to avoid having to consider all children of zz, the algorithm first computes (an arbitrary) subset ZZ^{\prime} of ZZ such that |Z|=#C(,k,i,m)+2|Z^{\prime}|=\textup{\#C}(\ell,k,i,m)+2. Then to be able to apply Lemma 9 without changing the set of solutions of II, the algorithm computes a subset Z′′Z^{\prime\prime} of ZZ^{\prime} such that |Z′′|=#C(,k,i,m)+1|Z^{\prime\prime}|=\textup{\#C}(\ell,k,i,m)+1 and for every zZ′′z^{\prime}\in Z^{\prime\prime} it holds that sz′′=0s_{z^{\prime\prime}}=0 for every z′′Tzz^{\prime\prime}\in T_{z^{\prime}}. Note that since there are at most kk variables of II with non-zero coefficients in η\eta and these variables form a clique in GIG_{I}, all of them occur only in a single branch of TzT_{z}. It follows that Z′′Z^{\prime\prime} as specified above exists and it can be obtained from ZZ^{\prime} by removing the (at most one) element zz^{\prime} in ZZ^{\prime} with sz′′0s_{z^{\prime\prime}}\neq 0 for some z′′Tzz^{\prime\prime}\in T_{z^{\prime}}. Observe that this step of the algorithm takes time at most 𝒪(m(#C(,k,i,m)+1))\mathcal{O}(m\cdot(\textup{\#C}(\ell,k,i,m)+1)).

The algorithm then proceeds as follows. It uses Lemma 9 to find two variables x,yZ′′x,y\in Z^{\prime\prime} such that xyx\sim y and computes II^{\prime} from II by omitting TyT_{y} from II. The running time of the algorithm follows from Lemma 9 since the running times of the other steps of the algorithm are dominated by the application of Lemma 9. The corollary now follows from Lemma 7 and Lemma 9, which certify that:

  • there exists a solution α\alpha of II of value w=η(α)w=\eta(\alpha) if and only if there exists a solution α\alpha^{\prime} of II^{\prime} of value ww, and

  • a solution α\alpha can be computed from any solution α\alpha^{\prime} in linear time. ∎

Let eie_{i} and did_{i} for every ii with 1ik1\leq i\leq k be defined inductively by setting ek=1e_{k}=1, dk=0d_{k}=0, di=#C(,k,i,si+1)+1d_{i}=\textup{\#C}(\ell,k,i,s_{i+1})+1, and ei=diei+1+1e_{i}=d_{i}e_{i+1}+1. The following Lemma shows that in time 𝒪(|I|d12e1!e1)\mathcal{O}(|I|d_{1}^{2}\cdot e_{1}!e_{1}) one can compute an “equivalent” subinstance II^{\prime} of II containing at most e1e_{1} variables. Informally, eie_{i} is an upper bound on the number of nodes in a subtree rooted at depth ii and did_{i} is an upper bound on the number of children of a node at level ii in II^{\prime}.

Lemma 11.

There exists an algorithm that takes as input II and TT, runs in time 𝒪(|I|d12e1!e1){\mathcal{O}}(|I|d_{1}^{2}\cdot e_{1}!e_{1}) and outputs an ILP instance II^{\prime} containing at most e1e_{1} variables with the following property: there exists a solution α\alpha of II of value w=η(α)w=\eta(\alpha) if and only if there exists a solution α\alpha^{\prime} of II^{\prime} of value w=η(α)w=\eta^{\prime}(\alpha^{\prime}). Moreover, a solution α\alpha can be computed from any solution α\alpha^{\prime} in linear time.

Proof.

The algorithm exhaustively applies Corollary 10 to every variable of TT in a bottom-up manner, i.e., it starts by applying the corollary exhaustively to all variables at depth k1k-1 and then proceeds up the levels of TT until it reaches depth 11. Let TT^{\prime} be the subtree of TT obtained after the exhaustive application of Corollary 10 to TT.

We will first show that if xx is a variable at depth ii of TT^{\prime}, then xx has at most did_{i} children and |Tx|ei|T_{x}^{\prime}|\leq e_{i}. We will show the claim by induction on the depth ii starting from depth kk. Because all variables xx of TT at level kk are leaves, it holds that xx has 0=dk0=d_{k} children in TT^{\prime} and |Tx|=1ek|T_{x}^{\prime}|=1\leq e_{k}, showing the start of the induction. Now let xx be a variable at depth ii of TT^{\prime} and let yy be a child of xx in TT^{\prime}. It follows from the induction hypothesis that |Ty|ei+1|T_{y}^{\prime}|\leq e_{i+1}. Moreover, using Corollary 10, we obtain that xx has at most #C~(,k,i,ei+1)+1=di\tilde{\textup{\#C}}(\ell,k,i,e_{i+1})+1=d_{i} children in TT^{\prime} and thus |Tx|diei+1+1=ei|T_{x}^{\prime}|\leq d_{i}e_{i+1}+1=e_{i}, as required.

The running time of the algorithm now follows from the observation that (because every application of Corollary 10 removes at least one variable of II) Corollary 10 is applied at most |I||I| times and moreover the maximum running time of any call to Corollary 10 is at most 𝒪(d12e1!e1)\mathcal{O}(d_{1}^{2}\cdot e_{1}!e_{1}). Correctness and the fact that α\alpha can be computed from α\alpha^{\prime} follow from Corollary 10; more specifically, we extend α\alpha^{\prime} into α\alpha by assigning pruned variables in the same way as their equivalent counterparts. ∎

Proof of Theorem 6.

The algorithm proceeds in three steps. First, it applies Lemma 11 to reduce the instance II into an “equivalent” instance II^{\prime} containing at most e1e_{1} variables in time 𝒪(|I|d12e1!e1){\mathcal{O}}(|I|d_{1}^{2}\cdot e_{1}!e_{1}); in particular, a solution α\alpha of II can be computed in linear time from a solution α\alpha^{\prime} of II^{\prime}. Second, it uses Theorem 1 to compute a solution α\alpha^{\prime} of II^{\prime} in time at most 𝒪(e12.5e1+o(e1)|I|)\mathcal{O}(e_{1}^{2.5e_{1}+o(e_{1})}\cdot|I^{\prime}|); because e1e_{1} and d1d_{1} are bounded by our parameters, the whole algorithm runs in FPT time. Third, it transforms the solution α\alpha^{\prime} into a solution α\alpha of II. Correctness follows from Lemma 11 and Theorem 1. ∎

4 Lower Bounds and Hardness

In this section we will complement our algorithmic results by providing matching hardness results. Namely, we will show that already the ILP-feasibility problem is NP-hard on graphs of bounded treedepth and also NP-hard on graphs of bounded treewidth and bounded maximum coefficient11 1 Unless explicitly mentioned otherwise, all the presented NP-hardness results hold in the strong sense, i.e., when the input is encoded in unary..

We begin by noting that ILP-feasibility remains NP-hard even if the maximum absolute value of any coefficient is at most one. This follows, e.g., by enhancing the standard reduction from the decision version of Vertex Cover (given a graph GG and a bound ν\nu, does GG admit a vertex cover of size at most ν\nu?) to ILP-feasibility as follows:

  • add variables x1,,xνx_{1},\dots,x_{\nu} and force each of them to be 11,

  • set x=i[ν]xix=\sum_{i\in[\nu]}x_{i},

  • add a constraint requiring that the sum of all variables which represent vertices of GG is at most xx.

Observation 1.

ILP-feasibility is NP-hard even on instances with a maximum absolute value of every coefficient of 11.

To simplify the constructions in the hardness proofs, we will often talk about constraints as equalities instead of inequalities. Clearly, every equality can be written in terms of two inequalities.

Theorem 12.

ILP-feasibility is NP-hard even on instances of bounded treedepth.

Proof.

We will show the theorem by a polynomial-time reduction from the well-known NP-hard 33-Colorability problem [16]: given a graph, decide whether the vertices of GG can be colored with three colors such that no two adjacent vertices of GG share the same color.

The main idea behind the reduction is to represent a 33-partition of the vertex set of GG (which in turn represents a 33-coloring of GG) by the domain values of three “global” variables. The value of each of these global variables will represent a subset of vertices of GG that will be colored using the same color. To represent a subset of the vertices of GG in terms of domain values of the global variables, we will represent every vertex of GG with a unique prime number and a subset by the value obtained from the multiplication of all prime numbers of vertices contained in the subset. To ensure that the subsets represented by the global variables correspond to a valid 33-partition of GG we will introduce constraints which ensure that:

  • C1

    For every prime number representing some vertex of GG exactly one of the global variables is divisible by that prime number. This ensures that every vertex of GG is assigned to exactly one color class.

  • C2

    For every edge {u,v}\{u,v\} of GG it holds that no global variable is divisible by the prime numbers representing uu and vv at the same time. This ensures that no two adjacent vertices of GG are assigned to the same color class.

Thus let GG be the given instance of 33-Coloring and assume that the vertices of GG are uniquely identified as elements of {1,,|V(G)|}\{1,\dots,|V(G)|\}. In the following we denote by p(i)p(i) the ii-th prime number for any positive integer ii, where p(1)=2p(1)=2. We construct an instance II of ILP-feasibility in polynomial-time with treedepth at most 88 and coefficients bounded by a polynomial in V(G)V(G) such that GG has a 33-coloring if and only if II has a feasible assignment. This instance II has the following variables:

  • The global variables g1g_{1}, g2g_{2}, and g3g_{3} with an arbitrary positive domain, whose values will represent a valid 33-Partioning of V(G)V(G).

  • For every ii and jj with 1i|V(G)|1\leq i\leq|V(G)| and 1j31\leq j\leq 3, the variables mi,jm_{i,j} (with an arbitrary non-negative domain), ri,jr_{i,j} (with domain between 00 and p(i)1p(i)-1), and ui,ju_{i,j} (with binary domain). These variables are used to secure condition C1.

  • For every eE(G)e\in E(G), vev\in e, and jj with 1j31\leq j\leq 3, the variables me,v,jm_{e,v,j} (with an arbitrary non-negative domain), re,v,jr_{e,v,j} (with domain between 00 and p(v)1p(v)-1), and ue,v,ju_{e,v,j} (with binary domain). These variables are used to secure condition C2.

II has the following constraints (in the following let α\alpha be any feasible assignment of II):

  • Constraints that restrict the domains of all variables as specified above, i.e.:

    • for every ii and jj with 1i|V(G)|1\leq i\leq|V(G)| and 1j31\leq j\leq 3, the constraints gj0g_{j}\geq 0, mi,j0m_{i,j}\geq 0, 0ri,jp(i)10\leq r_{i,j}\leq p(i)-1, and 0ui,j10\leq u_{i,j}\leq 1.

    • for every eE(G)e\in E(G), vev\in e, and jj with 1j31\leq j\leq 3, the constraints me,v,j0m_{e,v,j}\geq 0, 0re,v,jp(v)10\leq r_{e,v,j}\leq p(v)-1, and 0ue,v,j10\leq u_{e,v,j}\leq 1.

  • The following constraints, introduced for each 1i|V(G)|1\leq i\leq|V(G)| and 1j31\leq j\leq 3, together guarantee that condition C1 holds:

    • Constraints that ensure that α(ri,j)\alpha(r_{i,j}) is equal to the remainder of α(gj)\alpha(g_{j}) divided by p(i)p(i), i.e., the constraint gj=p(i)mi,j+ri,jg_{j}=p(i)m_{i,j}+r_{i,j}.

    • Constraints that ensure that α(ui,j)=0\alpha(u_{i,j})=0 if and only if α(ri,j)=0\alpha(r_{i,j})=0, i.e., the constraints ui,jri,ju_{i,j}\leq r_{i,j} and ri,j(p(i)1)ui,jr_{i,j}\leq(p(i)-1)u_{i,j}. Note that together the above constraints now ensure that α(ui,j)=0\alpha(u_{i,j})=0 if and only if gjg_{j} is divisible by p(i)p(i).

    • Constraints that ensure that exactly one of α(ui,1)\alpha(u_{i,1}), α(ui,2)\alpha(u_{i,2}), and α(ui,3)\alpha(u_{i,3}) is equal to 00, i.e., the constraints 2ui,1+ui,2+ui,322\leq u_{i,1}+u_{i,2}+u_{i,3}\leq 2. Note that together all the above constraints now ensure condition C1 holds.

  • The following constraints, introduced for each 1j31\leq j\leq 3, together guarantee that condition C2 holds:

    • Constraints that ensure that for every eE(G)e\in E(G) and vev\in e, it holds that α(re,v,j)\alpha(r_{e,v,j}) is equal to the remainder of gjg_{j} divided by p(v)p(v), i.e., the constraint gj=p(i)me,v,j+re,v,jg_{j}=p(i)m_{e,v,j}+r_{e,v,j}.

    • Constraints that ensure that for every eE(G)e\in E(G), vev\in e, and jj with 1j31\leq j\leq 3 it holds that α(ue,v,j)=0\alpha(u_{e,v,j})=0 if and only if α(re,v,j)=0\alpha(r_{e,v,j})=0, i.e., the constraints ue,v,jre,v,ju_{e,v,j}\leq r_{e,v,j} and re,v,jp(v)ue,v,jr_{e,v,j}\leq p(v)u_{e,v,j}. Note that together the above constraints now ensure that α(ue,v,j)=0\alpha(u_{e,v,j})=0 if and only if gjg_{j} is divisible by p(v)p(v).

    • Constraints that ensure that for every e={v,w}E(G)e=\{v,w\}\in E(G) and jj with 1j31\leq j\leq 3 it holds that at least one of α(ue,w,j)\alpha(u_{e,w,j}) and α(ue,v,j)\alpha(u_{e,v,j}) is non-zero, i.e., the constraint ue,u,j+ue,v,j1u_{e,u,j}+u_{e,v,j}\geq 1. Note that together with all of the above constraints this now ensures condition C2.

This completes the construction of II and the largest coefficient used in II is p(|V(G)|)p(|V(G)|). It is well-known that p(i)p(i) is upper-bounded by 𝒪(ilogi)\mathcal{O}(i\log i) due to the Prime Number Theorem, and so this in particular implies that the numbers which occur in II are bounded by a polynomial in |V(G)||V(G)|. Hence II can be constructed in polynomial time.

Following the construction and explanations provided above, it is not difficult to see that II has a feasible assignment if and only if GG has a 33-coloring. Indeed, for any 33-coloring of GG, one can construct a feasible assignment of II by computing the prime-number encoding for the vertex sets that receive colors 1,2,31,2,3 and assign these three numbers to g1,g2,g3g_{1},g_{2},g_{3}, respectively. Such an assignment allows us to straightforwardly satisfy the constraints ensuring C1 holds (since each prime occurs in exactly one global constraint), the constraints ensuring C2 holds (since each edge is incident to at most one of each color) while maintaining the domain bounds.

On the other hand, for any feasible assignment α\alpha, clearly each of α(g1),α(g2),α(g3)\alpha(g_{1}),\alpha(g_{2}),\alpha(g_{3}) will be divisible by some subset of prime numbers between 22 and p(|V(G)|)p(|V(G)|). In particular, since α\alpha is feasible it follows from the construction of our first group of constraints that each prime between 22 and p(|V(G)|)p(|V(G)|) divides precisely one of α(g1),α(g2),α(g3)\alpha(g_{1}),\alpha(g_{2}),\alpha(g_{3}), and so this uniquely encodes a corresponding candidate 33-coloring for the vertices of the graph. Finally, since α\alpha also satisfies the second group of constraints, this candidate 33-coloring must have the property that each edge is incident to exactly 22 colors, and so it is in fact a valid 33-coloring.

mi,1m_{i,1}mi,2m_{i,2}mi,3m_{i,3}ri,1r_{i,1}ri,2r_{i,2}ri,3r_{i,3}ui,1u_{i,1}ui,2u_{i,2}ui,3u_{i,3}
me,v,jm_{e,v,j}me,w,jm_{e,w,j}re,v,jr_{e,v,j}re,w,jr_{e,w,j}ue,v,ju_{e,v,j}ue,w,ju_{e,w,j}
Figure 1: Illustration of a vertex-type component (left) and an edge-type component (right) in the graph GI{g1,g2,g3}G_{I}\setminus\{g_{1},g_{2},g_{3}\}.

It remains to show that the treedepth of II is at most 88. We will show this by using the characterization of treedepth given in Proposition 4. We first observe that the graph GI{g1,g2,g3}G_{I}\setminus\{g_{1},g_{2},g_{3}\} consists of the following components:

  • for every ii with 1i|V(G)|1\leq i\leq|V(G)|, one component on the vertices mi,1,,mi,3m_{i,1},\dotsc,m_{i,3}, ri,1,ri,2,ri,3r_{i,1},r_{i,2},r_{i,3}, ui,1,ui,2,ui,3u_{i,1},u_{i,2},u_{i,3}. Note that all of these components are isomorphic to each other and we will therefore in the following refer to these components as vertex-type components.

  • for every e={w,v}E(G)e=\{w,v\}\in E(G) and jj with 1j31\leq j\leq 3, one component on the vertices me,w,jm_{e,w,j}, me,v,jm_{e,v,j}, re,w,jr_{e,w,j}, re,v,jr_{e,v,j}, ue,w,ju_{e,w,j}, and ue,v,ju_{e,v,j}. Note that all of these components are isomorphic to each other and we will therefore in the following refer to these components as edge-type components.

The two types of components are illustrated in Figure 1. We will show next that any vertex-type component has treedepth at most 55 and every edge-type component has treedepth at most 44. This would then imply that GIG_{I} has treedepth at most 88 (since it suffices to remove the vertices {g1,g2,g3}\{g_{1},g_{2},g_{3}\} in order to decompose the graph into these components). Hence let ii with 1i|V(G)|1\leq i\leq|V(G)| and consider the vertex-type component CiC_{i} on the vertices mi,1,mi,2,mi,3m_{i,1},m_{i,2},m_{i,3}, ri,1,ri,2,ri,3r_{i,1},r_{i,2},r_{i,3}, ui,1,ui,2,ui,3u_{i,1},u_{i,2},u_{i,3}. Note that Ci{ui,1,ui,2,ui,3}C_{i}\setminus\{u_{i,1},u_{i,2},u_{i,3}\} consists of one component for every jj with 1j31\leq j\leq 3 that contains the vertices mi,jm_{i,j} and ri,jr_{i,j}. Clearly each of these three components has treedepth at most 22 and hence the treedepth of CiC_{i} is at most 2+3=52+3=5, as required.

In order to show that every edge-type component has treedepth at most 44, consider an edge e={w,v}E(G)e=\{w,v\}\in E(G) and some jj satisfying 1j31\leq j\leq 3. Let Ce,jC_{e,j} be the edge-type component consisting of the vertices me,w,jm_{e,w,j}, me,v,jm_{e,v,j}, re,w,jr_{e,w,j}, re,v,jr_{e,v,j}, ue,w,ju_{e,w,j}, and ue,v,ju_{e,v,j}. Note that Ce,j{ue,w,j,ue,v,j}C_{e,j}\setminus\{u_{e,w,j},u_{e,v,j}\} consists of two components, one containing the vertices me,w,jm_{e,w,j} and re,u,jr_{e,u,j} and one containing the vertices me,v,jm_{e,v,j} and re,v,jr_{e,v,j}. Clearly, each of these two components has treedepth at most 22 and hence the treedepth of Ce,jC_{e,j} is at most 2+2=42+2=4, as required. ∎

The next theorem shows that ILP-feasibility is paraNP-hard parameterized by both treewidth and the maximum absolute value of any number in the instance; observe that since we are bounding all numbers in the instance, the theorem in particular implies NP-hardness. We note that the idea to reduce from Subset Sum was inspired by previous work of Jansen and Kratsch [20].

Theorem 13.

ILP-feasibility is NP-hard even on instances with treewidth at most two and where the maximum absolute value of any coefficient is at most one.

Proof.

We show the result by a polynomial reduction from the Subset Sum problem, which is well-known to be weakly NP-complete.

Subset Sum
Input: A set Q:={q1,,qn}Q:=\{q_{1},\dotsc,q_{n}\} of integers and an integer rr. Question: Is there a subset QQQ^{\prime}\subseteq Q such that qQq=r\sum_{q^{\prime}\in Q^{\prime}}q^{\prime}=r?

Let I:=(Q,r)I:=(Q,r) with Q:={q1,,qn}Q:=\{q_{1},\dotsc,q_{n}\} be an instance of Subset Sum, which we assume to be given in binary encoding. We will construct an instance II^{\prime} of ILP-feasibility equivalent to II in polynomial-time (with respect to the input size of II) with treewidth at most 22 that uses only 1-1, 00, and 11 as coefficients. Crucial to our construction are the following auxiliary ILP instances.

xxz0z_{0}z1z_{1}z2z_{2}zm2z_{m-2}zm1z_{m-1}zmz_{m}yyh0h_{0}h1h_{1}h2h_{2}hm2h_{m-2}hm1h_{m-1}hmh_{m}h0h_{0}^{\prime}h1h_{1}^{\prime}h2h_{2}^{\prime}hm2h_{m-2}^{\prime}hm1h_{m-1}^{\prime}
Figure 2: Illustration of the primal graph of the instance I(q,x,y)I(q,x,y).
I(q1,y1)I(q_{1},y_{1})y1y_{1}I(q2,y1,y2)I(q_{2},y_{1},y_{2})y2y_{2}I(qn,yn1,yn)I(q_{n},y_{n-1},y_{n})yn1y_{n-1}yny_{n}IC(r,yn)I_{C}(r,y_{n})
Figure 3: Illustration of the ILP instance II^{\prime}.
Claim 1.

For every qq\in{\mathbb{N}} and any two variables xx and yy there is an ILP instance I(q,x,y)I(q,x,y) satisfying the following conditions:

  • (P1)

    I(q,x,y)I(q,x,y) has at most 𝒪(logq)\mathcal{O}(\log q) variables and constraints,

  • (P2)

    the maximum absolute value of any coefficient in I(q,x,y)I(q,x,y) is at most one,

  • (P3)

    the treewidth of I(q,x,y)I(q,x,y) is at most two and

  • (P4)

    for every feasible assignment α\alpha of I(q,x,y)I(q,x,y), it holds that α(y){α(x),α(x)+q}\alpha(y)\in\{\alpha(x),\alpha(x)+q\}.

Moreover, there are ILP instances I(q,y)I(q,y) and IC(q,y)I_{C}(q,y) satisfying (P1)–(P3) and additionally:

  • α(y){0,q}\alpha(y)\in\{0,q\} for I(q,y)I(q,y), and

  • α(y)=q\alpha(y)=q for IC(q,y)I_{C}(q,y).

Proof.

For an integer qq, let B(q)B(q) be the set of indices of all bits that are equal to one in the binary representation of qq, i.e., we have q=jB(q)2jq=\sum_{j\in B(q)}2^{j}. Moreover, let m=bmax(q)m=b_{\max}(q) be the largest index in B(q)B(q).

We construct the ILP instance I(q,x,y)I(q,x,y) as follows. We first introduce m+1m+1 variables h0,,hmh_{0},\dotsc,h_{m} together with mm variables h0,,hm1h_{0}^{\prime},\dotsc,h_{m-1}^{\prime} and add the following constraints: 0h010\leq h_{0}\leq 1, and for every ii with 0i<m0\leq i<m we set hi=hih_{i}^{\prime}=h_{i} and hi+1=hi+hih_{i+1}=h_{i}+h_{i}^{\prime}. Observe that the above constraints ensure that α(hi)\alpha(h_{i}) is equal to 2iα(h0)2^{i}\alpha(h_{0}) for every ii with 0im0\leq i\leq m and every feasible assignment α\alpha. We also introduce the new auxiliary variables z0,,zmz_{0},\dotsc,z_{m} together with the following constraints:

  • If 0B(q)0\in B(q) then we add the constraint z0=h0+xz_{0}=h_{0}+x, and otherwise we add the constraint z0=xz_{0}=x.

  • For every ii with 0i<m0\leq i<m, if i+1B(q)i+1\in B(q) then we add the constraint zi+1=hi+1+ziz_{i+1}=h_{i+1}+z_{i} and otherwise the constraint zi+1=ziz_{i+1}=z_{i}.

Observe that these constraints ensure that α(zi)\alpha(z_{i}) is equal to α(x)+jB(q)jiα(hj)\alpha(x)+\sum_{j\in B(q)\land j\leq i}\alpha(h_{j}) for every ii with 0im0\leq i\leq m and any feasible assignment α\alpha. Finally we introduce the constraint y=zmy=z_{m}. This concludes the construction of I(q,x,y)I(q,x,y). By construction I(q,x,y)I(q,x,y) satisfies (P1) and (P2). Moreover, because α(y)=α(zm)\alpha(y)=\alpha(z_{m}) is equal to qα(h0)+α(x)q\alpha(h_{0})+\alpha(x) for any feasible assignment α\alpha and since α(h0){0,1}\alpha(h_{0})\in\{0,1\}, we obtain that α(y){α(x),α(x)+q}\alpha(y)\in\{\alpha(x),\alpha(x)+q\} showing that I(q,x,y)I(q,x,y) satisfies (P4). Finally, with the help of Figure 2, it is straightforward to verify that I(q,x,y)I(q,x,y) has treewidth at most two.

The ILP instance I(q,y)I(q,y) can now be obtained from I(q,x,y)I(q,x,y) by removing the variable xx. Moreover, the ILP instance IC(q,y)I_{C}(q,y) can now be obtained from I(q,y)I(q,y) by replacing the constraints 0h010\leq h_{0}\leq 1 with the constraint h0=1h_{0}=1. ∎

We now obtain II^{\prime} as the (non-disjoint) union of the instances I(q1,y1)I(q_{1},y_{1}), I(qi,yi1,yi)I(q_{i},y_{i-1},y_{i}) for every ii with 1<in1<i\leq n, and the instance IC(r,yn)I_{C}(r,y_{n}) (see Figure 3 for an illustration of II^{\prime}). The size of each of these n+1n+1 instances is bounded by 𝒪(logm)\mathcal{O}(\log m), where mm is the maximum of {q1,,qn,r}\{q_{1},\dotsc,q_{n},r\}, and it can be verified that each of these instances can be constructed in time 𝒪(logm)\mathcal{O}(\log m). Hence the construction of II^{\prime} from II can be completed in polynomial time (with respect to the size of the binary encoding of II). We also observe that the maximum absolute value of any coefficient in II^{\prime} is at most 11. Finally, because II^{\prime} is a simple concatenation of ILP instances with treewidth at most 22, it is straightforward to verify that II^{\prime} has treewidth at most 22. ∎

5 Concluding Notes

We presented new results that add to the complexity landscape for ILP w.r.t. structural parameterizations of the constraint matrix. Our main algorithmic result pushes the frontiers of tractability for ILP instances and will hopefully serve as a precursor for the study of further structural parameterizations for ILP. We note that the running time of the presented algorithm has a highly nontrivial dependence on the treedepth of the ILP instance, and hence the algorithm is unlikely to outperform dedicated solvers in practical settings.

The provided results draw an initial complexity landscape for ILP w.r.t. the most prominent decompositional width parameters. However, other approaches exploiting the structural properties of ILP instances still remain unexplored and represent interesting directions for future research. For instance, an adaptation of backdoors [17] to the ILP setting could lead to highly relevant algorithmic results.

Acknowledgments

The authors acknowledge support by the Austrian Science Fund (FWF, project P26696). Robert Ganian is also affiliated with FI MU, Brno, Czech Republic. The authors also thank the anonymous reviewers for many insightful suggestions and comments—and in particular for helping improve Theorem 13.

References

  • Alumur and Kara [2008] Alumur, S. A., and Kara, B. Y. 2008. Network hub location problems: The state of the art. European Journal of Operational Research 190(1):1–21.
  • Courcelle, Makowsky, and Rotics [2000] Courcelle, B.; Makowsky, J. A.; and Rotics, U. 2000. Linear time solvable optimization problems on graphs of bounded clique-width. Theory Comput. Syst. 33(2):125–150.
  • Cunningham and Geelen [2007] Cunningham, W. H., and Geelen, J. 2007. On integer programming and the branch-width of the constraint matrix. In Fischetti, M., and Williamson, D. P., eds., Integer Programming and Combinatorial Optimization, 12th International IPCO Conference, Ithaca, NY, USA, June 25-27, 2007, Proceedings, volume 4513 of Lecture Notes in Computer Science, 158–166. Springer.
  • Cygan et al. [2015] Cygan, M.; Fomin, F. V.; Kowalik, L.; Lokshtanov, D.; Marx, D.; Pilipczuk, M.; Pilipczuk, M.; and Saurabh, S. 2015. Parameterized Algorithms. Springer.
  • De Loera, Hemmecke, and Köppe [2013] De Loera, J. A.; Hemmecke, R.; and Köppe, M. 2013. Algebraic and Geometric Ideas in the Theory of Discrete Optimization, volume 14 of MOS-SIAM Series on Optimization. SIAM.
  • Diestel [2012] Diestel, R. 2012. Graph Theory, 4th Edition, volume 173 of Graduate texts in mathematics. Springer.
  • Downey and Fellows [2013] Downey, R. G., and Fellows, M. R. 2013. Fundamentals of Parameterized Complexity. Texts in Computer Science. Springer.
  • Fellows et al. [2008] Fellows, M. R.; Lokshtanov, D.; Misra, N.; Rosamond, F. A.; and Saurabh, S. 2008. Graph layout problems parameterized by vertex cover. In ISAAC, Lecture Notes in Computer Science, 294–305. Springer.
  • Fischer, Makowsky, and Ravve [2008] Fischer, E.; Makowsky, J. A.; and Ravve, E. R. 2008. Counting truth assignments of formulas of bounded tree-width or clique-width. Discr. Appl. Math. 156(4):511–529.
  • Floudas and Lin [2005] Floudas, C., and Lin, X. 2005. Mixed integer linear programming in process scheduling: Modeling, algorithms, and applications. Annals of Operations Research 139(1):131–162.
  • Flum and Grohe [2006] Flum, J., and Grohe, M. 2006. Parameterized Complexity Theory, volume XIV of Texts in Theoretical Computer Science. An EATCS Series. Berlin: Springer Verlag.
  • Frank and Tardos [1987] Frank, A., and Tardos, É. 1987. An application of simultaneous diophantine approximation in combinatorial optimization. Combinatorica 7(1):49–65.
  • Ganian and Szeider [2015] Ganian, R., and Szeider, S. 2015. Community structure inspired algorithms for SAT and #SAT. In Theory and Applications of Satisfiability Testing - SAT 2015 - 18th International Conference, Austin, Texas, US, September 24-27, 2015, Proceedings (to appear). Springer.
  • [14] Ganian, R.; Hliněný, P.; and Obdržálek, J. Better algorithms for satisfiability problems for formulas of bounded rank-width. Fundam. Inform. 123(1):59–76.
  • Ganian, Kim, and Szeider [2015] Ganian, R.; Kim, E. J.; and Szeider, S. 2015. Algorithmic applications of tree-cut width. In Mathematical Foundations of Computer Science 2015 - 40th International Symposium, MFCS 2015, Milan, Italy, August 24-28, 2015, Proceedings, Part II, 348–360.
  • Garey and Johnson [1979] Garey, M. R., and Johnson, D. R. 1979. Computers and Intractability. San Francisco: W. H. Freeman and Company, New York.
  • Gaspers and Szeider [2012] Gaspers, S., and Szeider, S. 2012. Backdoors to satisfaction. In The Multivariate Algorithmic Revolution and Beyond - Essays Dedicated to Michael R. Fellows on the Occasion of His 60th Birthday, volume 7370 of Lecture Notes in Computer Science, 287–317. Springer Verlag.
  • Gutin, Jones, and Wahlström [2015] Gutin, G.; Jones, M.; and Wahlström, M. 2015. Structural parameterizations of the mixed chinese postman problem. In Algorithms - ESA 2015 - 23rd Annual European Symposium, Patras, Greece, September 14-16, 2015, Proceedings, 668–679.
  • Hemmecke, Onn, and Romanchuk [2013] Hemmecke, R.; Onn, S.; and Romanchuk, L. 2013. N-fold integer programming in cubic time. Math. Program 137(1-2):325–341.
  • Jansen and Kratsch [2015] Jansen, B. M. P., and Kratsch, S. 2015. A structural approach to kernels for ILPs: Treewidth and total unimodularity. In Algorithms - ESA 2015 - 23rd Annual European Symposium, Patras, Greece, September 14-16, 2015, Proceedings, volume 9294 of Lecture Notes in Computer Science, 779–791. Springer.
  • Kannan [1987] Kannan, R. 1987. Minkowski’s convex body theorem and integer programming. Math. Oper. Res. 12(3):415–440.
  • Lenstra and Jr. [1983] Lenstra, H. W., and Jr. 1983. Integer programming with a fixed number of variables. Math. Oper. Res. 8(4):538–548.
  • Lodi, Martello, and Monaci [2002] Lodi, A.; Martello, S.; and Monaci, M. 2002. Two-dimensional packing problems: A survey. European Journal of Operational Research 141(2):241–252.
  • Nešetřil and Ossona de Mendez [2012] Nešetřil, J., and Ossona de Mendez, P. 2012. Sparsity: Graphs, Structures, and Algorithms, volume 28 of Algorithms and Combinatorics. Springer.
  • Niedermeier [2006] Niedermeier, R. 2006. Invitation to Fixed-Parameter Algorithms. Oxford University Press.
  • Onn [2010] Onn, S. 2010. Nonlinear discrete optimization. Zurich Lectures in Advanced Mathematics, European Mathematical Society.
  • Papadimitriou and Steiglitz [1982] Papadimitriou, C. H., and Steiglitz, K. 1982. Combinatorial Optimization: Algorithms and Complexity. Prentice-Hall.
  • Papadimitriou [1981] Papadimitriou, C. H. 1981. On the complexity of integer programming. J. ACM 28(4):765–768.
  • Szeider [2003] Szeider, S. 2003. Finding paths in graphs avoiding forbidden transitions. Discr. Appl. Math. 126(2-3):239–251.
  • Toth and Vigo [2001] Toth, P., and Vigo, D., eds. 2001. The Vehicle Routing Problem. Philadelphia, PA, USA: Society for Industrial and Applied Mathematics.
  • van den Briel, Vossen, and Kambhampati [2005] van den Briel, M.; Vossen, T.; and Kambhampati, S. 2005. Reviving integer programming approaches for AI planning: A branch-and-cut framework. In Proceedings of the Fifteenth International Conference on Automated Planning and Scheduling (ICAPS 2005), June 5-10 2005, Monterey, California, USA, 310–319. AAAI.
  • Vossen et al. [1999] Vossen, T.; Ball, M. O.; Lotem, A.; and Nau, D. S. 1999. On the use of integer programming models in AI planning. In Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, IJCAI 99, Stockholm, Sweden, July 31 - August 6, 1999. 2 Volumes, 1450 pages, 304–309. Morgan Kaufmann.