Sample Page

In computer science, parameterized complexity is a branch of computational complexity theory that focuses on classifying computational problems according to their inherent difficulty with respect to multiple parameters of the input or output. The complexity of a problem is then measured as a function of those parameters. This allows the classification of NP-hard problems on a finer scale than in the classical setting, where the complexity of a problem is only measured as a function of the number of bits in the input. This appears to have been first demonstrated in Gurevich, Stockmeyer & Vishkin (1984). The first systematic work on parameterized complexity was done by Downey & Fellows (1999).

The existence of efficient, exact, and deterministic solving algorithms for NP-complete, or otherwise NP-hard, problems is considered unlikely, if input parameters are not fixed; all known solving algorithms for these problems require time that is exponential (so in particular super-polynomial) in the total size of the input. However, some problems can be solved by algorithms that are exponential only in the size of a fixed parameter while polynomial in the size of the input.

Under the assumption that P ≠ NP, there exist many natural problems that require super-polynomial running time when complexity is measured in terms of the input size only but that are computable in a time that is polynomial in the input size and exponential or worse in a parameter k. Hence, if k is fixed at a small value and the growth of the function over k is relatively small then such problems can still be considered “tractable” despite their traditional classification as “intractable”.

Such an algorithm is called a fixed-parameter tractable (FPT) algorithm, because the problem can be solved efficiently (i.e., in polynomial time) for constant values of the fixed parameter. A parameterized problem that allows for such an FPT algorithm is said to be a fixed-parameter tractable problem and belongs to the class FPT, and the early name of the theory of parameterized complexity was fixed-parameter tractability.

Setup

Many problems have the following form: given an object x and a nonnegative integer k, does x have some property that depends on k?

For instance, for the vertex cover problem, the parameter can be the number of vertices in the cover. The minimal vertex cover problem asks:

In many applications, for example when modelling error correction, one can assume the parameter to be “small” compared to the total input size. Then it is challenging to find an algorithm that is exponential only in k, and not in the input size.

In this way, parameterized complexity can be seen as two-dimensional complexity theory. This concept is formalized as follows:

A parameterized problem is a language , where is a finite alphabet. The second component is called the parameter of the problem.
A parameterized problem L is fixed-parameter tractable if the question “?” can be decided in running time , where f is an arbitrary function depending only on k. The corresponding complexity class is called FPT.
A parameterized problem uses the natural parameter when its parameter is the size of the solution to the problem.

For example, there is an algorithm that solves the vertex cover problem in time,[1] where n is the number of vertices and k is the size of the vertex cover. This means that vertex cover is fixed-parameter tractable with the size of the solution as the parameter (its natural parameter).

Complexity classes

FPT

FPT (fixed parameter tractable) is the class of decision problems decidable in deterministic time , where f is a computable function. Typically, this function is thought of as single exponential, such as , but the definition admits functions that grow even faster. This is essential for a large part of the early history of this class. The crucial part of the definition is to exclude functions of the form , such as .

The class FPL (fixed parameter linear) is the class of problems solvable in time for some computable function f.[2] FPL is thus a subclass of FPT. An example is the Boolean satisfiability problem, parameterised by the number of variables. A given formula of size m with k variables can be checked by brute force in time . A vertex cover of size k in a graph of order n can be found in time , so the vertex cover problem is also in FPL.

An example of a problem that is thought not to be in FPT is graph coloring parameterised by the number of colors. It is known that 3-coloring is NP-hard, and an algorithm for graph k-coloring in time for would run in polynomial time in the size of the input. Thus, if graph coloring parameterised by the number of colors were in FPT, then P = NP.

There are a number of alternative definitions of FPT. For example, the running-time requirement can be replaced by . Also, a parameterised problem is in FPT if it has a so-called kernel. Kernelization is a preprocessing technique that reduces the original instance to its “hard kernel”, a possibly much smaller instance that is equivalent to the original instance but has a size that is bounded by a function in the parameter.

FPT is closed under a parameterised notion of reductions called fpt-reductions. We say that one parameterized problem fpt-reduces to iff there exists two functions , such that

  • iff
  • is itself fixed parameter tractable.
    • That is, there exists a constant , and a function , such that is computable in time

Obviously, FPT contains all polynomial-time computable problems. Moreover, it contains all optimisation problems in NP that allow an efficient polynomial-time approximation scheme (EPTAS).

XP

XP is the class of parameterized problems that can be solved in time for some computable function f.

These problems are called slicewise polynomial, in the sense that each “slice” of fixed k has a polynomial-time algorithm, although with a possibly different exponent for each k. Compare this with FPT, which merely allows a different constant prefactor for each value of k.

XP strictly contains FPT by diagonalization.

para-NP

para-NP is the class of decision problems decidable in nondeterministic time for some computable function f.

if and only if .[3]

A problem is para-NP-hard if it is -hard already for a constant value of the parameter. That is, there is a “slice” of fixed k that is -hard. A parameterized problem that is -hard cannot belong to the class , unless . A classic example of a -hard parameterized problem is graph coloring, parameterized by the number k of colors, which is already -hard for (see Graph coloring#Computational complexity).

Hierarchies

In the parameterized complexity theory, there are some hierarchies of complexity classes. Each such class is closed under fpt-reduction. The most important ones are the W hierarchy and the A hierarchy.[4]

Preliminary definitions

In general, there are two ways to define a complexity class: machine-theoretically and logically. In machine theory, a class is defined as the set of decision problems solvable by a class of machines. In logic, a class is defined as the set of decision problems definable by a class of logical formulas.

Boolean circuits

The Hamming weight (weight for short) of a binary string is the number of ones appearing in it.

A Boolean circuit is an acyclic directed graph where the nodes are one of the following gates: AND, OR, NOT. A small gate is a gate with fan-in 0, 1, or 2. Other gates are big. The weft is the largest number of big gates achievable on any path from an input to the output. The depth is the largest number of gates (small or big) achievable on any path from an input to the output. By definition, weft ≤ depth.

A Boolean circuit is monotone iff it uses no NOT gate. A Boolean circuit is antimonotone iff it is of the form where are all its inputs, and is monotone.

Finite model theory

Given any:

we define to be the parameterized model checking problem for this tuple. Each problem instance is:

  • Input: , and a finite model for the language
  • Parameter:
  • Output: Whether

A formula is of the form , such that the quantifiers are alternating between existence and for-all, and the formula inside is quantifier-free (that is, written with just variables, Boolean connectives, and relations).[5][6]

A formula is of the form , with the extra condition that .

Definition

Machine-theoretically, a parameterized problem is in the class W[w][d], if there is a fpt-reduction of the problem as follows:

  • There exists constant integers , such that
  • every instance is transformed in fpt-time to a Boolean circuit that has weft at most w, and depth at most d,
  • if and only if the circuit has a satisfying assignment of weight k.

Here we see that “W” stands for “weight”. Note that in the above definition, are independent of , but the circuit itself depends on , and may change if one changes either or .

The class W[w] is then defined as their union:More succinctly, W[w] is the set of problems fpt-reducible to a family of instance-specific Boolean circuits with weft and depth bounded by some problem-specific constant.

A normalized circuit of weft w and depth d is a circuit, where the first layers contain only small gates, and the last layers contain alternating big gates of AND and OR. One can iterate the associative laws and de Morgan distribution laws to normalize the circuit in fpt-time. Therefore, without loss of generality, we can consider only normalized circuits.[7]

Model-theoretically, the class W[t] is defined as the class of problems fpt-reducible to .

While the W hierarchy is a hierarchy contained in NP, the A hierarchy more closely mimics the polynomial-time hierarchy from classical complexity. Machine-theoretically, the A hierarchy of problems are defined as problems that are fpt-reducible to computations by certain kinds of alternating Turing machines. The “A” stands for “alternating”.[6]

Model-theoretically, the class A[t] is defined as the class of problems fpt-reducible to .

For example, the k-clique problem can be specified as a model checking problem. The language has a single binary relation , where means “ share an edge”. Then, a finite model is a graph, and it has a k-clique iff , whereThis shows that the k-clique problem is in .

A problem is A[i]-complete if it is A[i], and any A[i] problem fpt-reduces to it.

Basic properties

By definition,:

  • since has no quantifiers at all, so there is no difference between and .
  • . For any FPT problem can be trivially fpt-reduced thus: Solve the problem in fpt-time, then output a trivial Yes/No circuit that does nothing except output the correct Boolean.
  • . For any W[0] problem , and any problem-instance , the circuitry has 0 weft and depth, where is fixed. Therefore, the output is determined by up to inputs. All other inputs are free for use. Therefore, one simply brute-force compute all possible inputs. If a certain input has weight k’ and makes the circuit output True, then check if there are still enough inputs to fill the weight: .

.[6]

W[1]

Intuitively, problems in W[1] class can be interpreted of the form: Is there an object of size k with a certain locally-checkable property? In formula, it would be of the form In fact, W[1] collapses to W[1, 2], the class of problems fpt-reducible to Boolean circuits of the form . That is, a big AND over many OR of fan-in 2.[8]

Examples of W[1]-complete problems include:[8]

  • Independent set
    • Input: a graph G
    • Parameter: an integer k
    • Output: Whether G contains an independent set of size k
  • Clique
    • Input: a graph G
    • Parameter: an integer k
    • Output: Whether G contains a clique of size k
  • Bipartite nonblocker
    • Input: a bipartite graph
    • Parameter: an integer k
    • Output: Whether there exists a subset of size k, such that any has a neighbor . In other words, does not block .
  • Weight-k 2-satisfiability
    • Input: a conjunctive normal formula of form , where i ranges over clauses.
    • Parameter: an integer k
    • Output: Whether there exists a weight-k satisfying assignment to the formula.
  • Short Turing machine problem.
    • Input: nondeterministic Turing machine M, a string x, an integer k.
    • Output: Whether there exists one computational path, with which M accepts x in at most k steps.

Note that the plain nonblocker problem is FPT.[9]

Note on the nondeterministic Turing machine. The machine may be specified by one of any of the standard formulations. One usually considers the one-tape Turing machine, but the short Turing machine problem remains W[1] even if we allow with f(k) tapes and even f(k) of f(k)-dimensional tapes, but even with this extension, the restriction to f(k) tape alphabet size is FPT. Crucially, because the machine M itself is part of the problem input, the input size n is bigger than the number of states of M. In this way, the Turing machine can take one of possible computation paths per step, accessing steps in total within time k. Thus, we see that W[1] is not obviously contained within FPT.

The independent set problem can be encoded thus. Given each graph , its independent set problem is encoded by the following weft-1 Boolean circuit:where is the set of edges in the graph. The graph has an independent set of size k iff there is a weight-k input to its Boolean circuit, such that it outputs 1.

The clique problem can be coded as It checks that any pair vertices that don’t make an edge cannot be chosen, so any chosen set of vertices is forced to be a clique.

The short Turing machine problem can be converted to a Boolean formula using the same proof idea as of the Cook–Levin theorem, which shows SAT is NP-complete by coding Turing machine computational traces as Boolean formulas. The following proof is from [8][10]. Specifically, define the propositional variables:

  • : at time t, the Turing machine is in state i, and transitions to state j, reading a, and writing b,
  • : at time t, the tape position p has symbol a, and at time (t+1) has symbol b.

Of the indices, time t and tape position p range over 1:k, The ranges of the indices to the Turing machine state i, j, transition m, and symbols a, b are determined by the description of the machine M, but they are both bounded within 1:n.

Then, the formula is a conjunction of clauses enforcing the following constraints:

  • Every Turing machine state transition is not disallowed by the nondeterministic transition rule. These look like , in other words, . There are such clauses.
  • The Turing machine cannot be at two positions at a time, and cannot make two transitions at a time.
  • Every tape cell state transition is not disallowed by the nondeterministic transition rule.
  • Every tape cell state cannot have two symbols at a time.
  • At time 0, the Turing machine is not out of its initial state and position, and x is not unwritten on the tape.
  • The Turing machine is not in an unaccepting state at time k.

A computational trace through the Turing machine is then fully specified by setting k variables of to True to indicate the Turing machine state transitions at each time, and setting variables of to True to indicate the tape state transition at each time. This reduces the short Turing machine problem to a problem of finding a weight- satisfying assignment to a weft-1, depth-2, antimonotone Boolean circuit.

W[2]

W[2] problems are intuitively of the form: Guess an object of size k, perform some local processing on the object, then perform one global processing.

Examples of W[2]-complete problems include

  • deciding if a given graph contains a dominating set of size k.
  • deciding if a given nondeterministic multi-tape Turing machine accepts within k steps (“short multi-tape Turing machine acceptance” problem). Crucially, the branching is allowed to depend on n (like the W[1] variant), as is the number of tapes. An alternate W[2]-complete formulation allows only single-tape Turing machines, but the alphabet size may depend on n.

The dominating set problem has formula .

W[i]

Some problems are known to be W[i]-complete, though they are in a computationally generic form, and are usually studied within parameterized complexity theory itself. Empirically, as of 2013, almost all naturally-occurring parameterized problems that they have studied, turned out to be W[0]-complete, W[1]-complete, or W[2]-complete. The following are usually used:[4]

  • Weighted i-Normalized Satisfiability:[7][4]: Thm. 23.2.1  Given a Boolean formula, written as an AND of ORs of ANDs of … of possibly negated variables, with layers of alternating ANDs or ORs, can it be satisfied by setting exactly k variables to 1?
    • Proof sketch: Any W[i]-circuit can be normalized in fpt-time by iterating association law and de Morgan distributive law, thus showing this problem is W[i]-complete.
  • If i>0 is even, then
    • .
    • Weighted Monotone i-Normalized Satisfiability is W[i]-complete.
    • Weighted Monotone (i+1)-Normalized Satisfiability is in W[i].
  • If i>0 is odd, then
    • Weighted Antionotone i-Normalized Satisfiability is W[i]-complete.
    • If , then Weighted Antimonotone (i+1)-Normalized Satisfiability is in W[i].

These problems are essentially “artificial”, in that they are not studied except within the context of parameterized complexity. The literature reports few naturally occurring problems that are W[i]-complete for :

  • Detection of inclusion dependencies in relational databases is W[3]-complete.
  • Certain problems in supply-chain models are W[3]-complete or W[4]-complete.[11]

W[SAT]

W[SAT] is the class of problems fpt-reducible to weighted SAT problems:[12]

  • Input: a Boolean formula
  • Parameter: k
  • Output: Whether the formula has a weight-k satisfying assignment.

It contains all W[t].

W[P]

W[P] is the class of problems fpt-reducible to the problem of weighted Boolean circuit problems:[12]

  • Input: a Boolean circuit
  • Parameter: k
  • Output: Whether there exists a weight-k input such that the circuit outputs True.

It contains W[SAT], since a Boolean formula can be efficiently converted to a Boolean circuit. Note that the opposite is not true in general, since the equivalent Boolean formula to a Boolean circuit may be necessarily exponentially larger than the circuit.

Equivalently, it is the class of problems that can be decided by a nondeterministic -time Turing machine that makes at most nondeterministic choices in the computation on (a k-restricted Turing machine). [13][4]

It is known that FPT is contained in W[P], and the inclusion is believed to be strict. However, resolving this issue would imply a solution to the P versus NP problem.

Other connections to unparameterised computational complexity are that FPT equals W[P] if and only if circuit satisfiability can be decided in time , or if and only if there is a computable, nondecreasing, unbounded function f such that all languages recognised by a nondeterministic polynomial-time Turing machine using nondeterministic choices are in P.

W[P] can be loosely thought of as the class of problems where we have a set S of n items, and we want to find a subset of size k such that a certain property holds. We can encode a choice as a list of k integers, stored in binary. Since the highest any of these numbers can be is n, bits are needed for each number. Therefore total bits are needed to encode a choice. Therefore we can select a subset with nondeterministic choices.

Other classes

The W* hierarchy is similar to the W hierarchy, but it parameterizes depth, rather than holding it constant. The W*[t] class is defined as the class of problems fpt-reducible to this problem:[5]

  • Input: a Boolean circuit of weft at most t, and depth at most k,
  • Parameter: k
  • Output: Whether the Boolean circuit has a weight-k satisfying assignment.

It is related to W by:[4]The AW hierarchy is obtained by adding alternation to the W hierarchy. The AW[t] class is defined as the class of problems fpt-reducible to this problem:[5][6]

  • Input: a Boolean circuit of weft at most t, and a partition of its inputs to
  • Parameter:
  • Output: Whether the Boolean circuit is satisfiable under alternating weight- conditions.

The alternating weight- is defined as follows:

  • There exists a subset of size , such that if we set exactly those inputs to True and the others to False, then,
  • for any subset of size , such that if we set exactly those inputs to True and the others to False, then,
  • the Boolean circuit outputs True.

One can interpret this as a 2-player game, with the first player trying to make the circuit output True, and the second player trying to make the circuit output False. The first player makes a move by setting exactly inputs of to True and the others to False, then the second player makes a move on , etc. The circuit is under alternating weight- conditions iff player 1 has a winning strategy.

It turns out that the hierarchy collapses: . Thus, the literature writes just a common symbol for them: .

See also

Notes

  1. ^ Chen, Kanj & Xia 2006
  2. ^ Grohe (1999)
  3. ^ Flum & Grohe (2006), p. 39.
  4. ^ a b c d e Downey, Rodney G.; Fellows, Michael R. (2013). “The W-Hierarchy”. Fundamentals of Parameterized Complexity. Texts in Computer Science. London: Springer London. pp. 427–459. doi:10.1007/978-1-4471-5559-1. ISBN 978-1-4471-5558-4.
  5. ^ a b c Flum, Joerg; Grohe, Martin (2005-03-07). “Model-Checking Problems as a Basis for Parameterized Intractability”. Logical Methods in Computer Science. 1 (1) 2272. doi:10.2168/LMCS-1(1:2)2005. ISSN 1860-5974.
  6. ^ a b c d Chen, Yijia; Flum, Jörg; Grohe, Martin (2005-06-12). “Machine-based methods in parameterized complexity theory”. Theoretical Computer Science. 339 (2): 167–199. doi:10.1016/j.tcs.2005.02.003. ISSN 0304-3975.
  7. ^ a b Downey, Rod G.; Fellows, Michael R. (August 1995). “Fixed-Parameter Tractability and Completeness I: Basic Results”. SIAM Journal on Computing. 24 (4): 873–921. doi:10.1137/S0097539792228228. ISSN 0097-5397.
  8. ^ a b c Downey, Rodney G.; Fellows, Michael R. (2013), “The Basic Class W[1] and an Analog of Cook’s Theorem”, Fundamentals of Parameterized Complexity, London: Springer London, pp. 383–406, doi:10.1007/978-1-4471-5559-1_21, ISBN 978-1-4471-5558-4{{citation}}: CS1 maint: work parameter with ISBN (link)
  9. ^ Dehne, Frank; Fellows, Michael; Fernau, Henning; Prieto, Elena; Rosamond, Frances (2006), Wiedermann, Jiří; Tel, Gerard; Pokorný, Jaroslav; Bieliková, Mária (eds.), “nonblocker: Parameterized Algorithmics for minimum dominating set”, SOFSEM 2006: Theory and Practice of Computer Science, vol. 3831, Berlin, Heidelberg: Springer Berlin Heidelberg, pp. 237–245, doi:10.1007/11611257_21, ISBN 978-3-540-31198-0{{citation}}: CS1 maint: work parameter with ISBN (link)
  10. ^ https://tcs.rwth-aachen.de/lehre/FPT/WS2021/slides-Dec-3.pdf
  11. ^ Chen, Jianer; Zhang, Fenghui (2005), Megiddo, Nimrod; Xu, Yinfeng; Zhu, Binhai (eds.), “On Product Covering in Supply Chain Models: Natural Complete Problems for W[3] and W[4]”, Algorithmic Applications in Management, vol. 3521, Berlin, Heidelberg: Springer Berlin Heidelberg, pp. 400–410, doi:10.1007/11496199_43, ISBN 978-3-540-26224-4, retrieved 2026-04-13{{citation}}: CS1 maint: work parameter with ISBN (link)
  12. ^ a b Downey, Rodney G.; Fellows, Michael R. (2013), “Beyond W[t]-Hardness”, Fundamentals of Parameterized Complexity, London: Springer London, pp. 473–489, doi:10.1007/978-1-4471-5559-1_25, ISBN 978-1-4471-5558-4{{citation}}: CS1 maint: work parameter with ISBN (link)
  13. ^ Flum & Grohe (2006)

References

  • Chen, Jianer; Kanj, Iyad A.; Xia, Ge (2006). Improved Parameterized Upper Bounds for Vertex Cover. Mathematical Foundations of Computer Science. Vol. 4162. Berlin, Heidelberg: Springer. pp. 238–249. CiteSeerX 10.1.1.432.831. doi:10.1007/11821069_21. ISBN 978-3-540-37791-7.
  • Fomin, Fedor V.; Lokshtanov, Daniel; Saurabh, Saket; Zehavi, Meirav (2019). Kernelization: Theory of Parameterized Preprocessing. Cambridge University Press. p. 528. doi:10.1017/9781107415157. ISBN 978-1107057760. S2CID 263888582.
  • Gurevich, Yuri; Stockmeyer, Larry; Vishkin, Uzi (1984). Solving NP-hard problems on graphs that are almost trees and an application to facility location problems. Journal of the ACM. p. 459-473.
  • Grohe, Martin (1999). “Descriptive and Parameterized Complexity”. Computer Science Logic. Lecture Notes in Computer Science. Vol. 1683. Springer Berlin Heidelberg. pp. 14–31. CiteSeerX 10.1.1.25.9250. doi:10.1007/3-540-48168-0_3. ISBN 978-3-540-66536-6.
  • The Computer Journal. Volume 51, Numbers 1 and 3 (2008). The Computer Journal. Special Double Issue on Parameterized Complexity with 15 survey articles, book review, and a Foreword by Guest Editors R. Downey, M. Fellows and M. Langston.

Textbooks