This book deals mostly with impossibility results - lower bounds on what can be accomplished by algorithms.
Author: Tim Roughgarden
Category: Computer algorithms
This text collects the lecture notes from the author's course "Communication Complexity (for Algorithm Designers)," taught at Stanford in the winter quarter of 2015. The two primary goals of the text are: (1) Learn several canonical problems in communication complexity that are useful for proving lower bounds for algorithms (disjointness, index, gap-hamming, etc.). (2) Learn how to reduce lower bounds for fundamental algorithmic problems to communication complexity lower bounds. Along the way, readers will also: (3) Get exposure to lots of cool computational models and some famous results about them -- data streams and linear sketches, compressive sensing, space-query time trade-offs in data structures, sublinear-time algorithms, and the extension complexity of linear programs. (4) Scratch the surface of techniques for proving communication complexity lower bounds (fooling sets, corruption arguments, etc.).
Therefore, we state some resources about communication complexity and its usage on ... which focusses on communication complexity for algorithm designers.
Author: Raffael Buff
Streaming problems are algorithmic problems that are mainly characterized by their massive input streams. Because of these data streams, the algorithms for these problems are forced to be space-efficient, as the input stream length generally exceeds the available storage. In this thesis, the two streaming problems most frequent item and number of distinct items are studied in detail relating to their algorithmic complexities, and it is compared whether the verification of solution hypotheses has lower algorithmic complexity than computing a solution from the data stream. For this analysis, we introduce some concepts to prove space complexity lower bounds for an approximative setting and for hypothesis verification. For the most frequent item problem which consists in identifying the item which has the highest occurrence within the data stream, we can prove a linear space complexity lower bound for the deterministic and probabilistic setting. This implies that, in practice, this streaming problem cannot be solved in a satisfactory way since every algorithm has to exceed any reasonable storage limit. For some settings, the upper and lower bounds are almost tight, which implies that we have designed an almost optimal algorithm. Even for small approximation ratios, we can prove a linear lower bound, but not for larger ones. Nevertheless, we are not able to design an algorithm that solves the most frequent item problem space-efficiently for large approximation ratios. Furthermore, if we want to verify whether a hypothesis of the highest frequency count is true or not, we get exactly the same space complexity lower bounds, which leads to the conclusion that we are likely not able to profit from a stated hypothesis. The number of distinct items problem counts all different elements of the input stream. If we want to solve this problem exactly (in a deterministic or probabilistic setting) or approximately with a deterministic algorithm, we require once again linear storage size which is tight to the upper bound. However, for the approximative and probabilistic setting, we can enhance an already known space-efficient algorithm such that it is usable for arbitrarily small approximation ratios and arbitrarily good success probabilities. The hypothesis verification leads once again to the same lower bounds. However, there are some streaming problems that are able to profit from additional information such as hypotheses, as e.g., the median problem.
Often, algorithm designers wish to determine if the data structure they have designed is the best possible. Communication complexity lower bounds can be ...
Author: Sanjeev Arora
Publisher: Cambridge University Press
This beginning graduate textbook describes both recent achievements and classical results of computational complexity theory. Requiring essentially no background apart from mathematical maturity, the book can be used as a reference for self-study for anyone interested in complexity, including physicists, mathematicians, and other scientists, as well as a textbook for a variety of courses and seminars. More than 300 exercises are included with a selected hint set. The book starts with a broad introduction to the field and progresses to advanced results. Contents include: definition of Turing machines and basic time and space complexity classes, probabilistic algorithms, interactive proofs, cryptography, quantum computation, lower bounds for concrete computational models (decision trees, communication complexity, constant depth, algebraic and monotone circuits, proof complexity), average-case complexity and hardness amplification, derandomization and pseudorandom constructions, and the PCP theorem.
In spite of the restricted communication model, localized algorithms can be slow. ... In some local algorithms  the algorithm designer can choose an ...
Author: Paola Flocchini
This book constitutes the refereed proceedings of the 13th International Colloquium on Structural Information and Communication Complexity, SIROCCO 2006, held in Chester, UK, July 2006. The book presents 24 revised full papers together with three invited talks, on topics in distributed and parallel computing, information dissemination, communication complexity, interconnection networks, high speed networks, wireless and sensor networks, mobile computing, optical computing, autonomous robots, and related areas.
In light of this, the goal for the algorithm designer is to produce an (simple and efficient) algorithm that stabilizes networks for all (or a fair chunk) ...
Author: Guy Even
This book constitutes the refereed proceedings of the 19th International Colloquium on Structural Information and Communication Complexity, SIROCCO 2012, held in Reykjavik, Iceland for 3 days starting June 30, 2012. The 28 revised full papers presented were carefully reviewed and selected from 54 submissions. SIROCCO is devoted to the study of communication and knowledge in distributed systems. Special emphasis is given to innovative approaches and fundamental understanding, in addition to efforts to optimize current designs. The typical areas include distributed computing, communication networks, game theory, parallel computing, social networks, mobile computing (including autonomous robots), peer to peer systems, communication complexity, fault tolerant graph theories, and randomized/probabilistic issues in networks.
It is the responsibility of the algorithm designer to ensure that there are no collisions, i.e., we must never have two agents in the same position in the ...
Author: Keren Censor-Hillel
This book constitutes the refereed conference proceedings of the 26th International Colloquium on Structural Information and Communication Complexity, SIROCCO 2019, held in L’Aquila, Italy, in July 2019. The 19 full papers and 9 short papers presented in this book were carefully reviewed and selected from 39 submissions. They are devoted to the study of the interplay between structural knowledge, communication, and computing in decentralized systems of multiple communicating entities.
... an output state to a non-output state, thus providing the algorithm designer with the possibility to escape output configurations that become incorrect.
Author: Jukka Suomela
This book constitutes the refereed proceedings of the 23rd International Colloquium on Structural Information and Communication Complexity, SIROCCO 2016, held in Helsinki, Finland in July 2016. The 25 full papers presented were carefully reviewed and selected from 50 submissions. The papers are organized around the following topics: message passing; shared memory; mobile agent; data dissemination and routing.
Hence, when targeting a given scenario from the real world, an algorithm designer may first record some topological traces from the target environment and ...
Author: Shantanu Das
This book constitutes the thoroughly refereed proceedings of the 24th International Colloquium on Structural Information and Communication Complexity, SIROCCO 2017, held in Porquerolles, France, in June 2017. The 21 full papers presented were carefully reviewed and selected from 41 submissions. They are devoted to the study of the interplay between structural knowledge, communications, and computing in decentralized systems of multiple communicating entities. They are organized around the following topics: wireless networks; identifiers and labeling; mobile agents; probabilistic algorithms; computational complexity; dynamic networks.
Author: Magnús M. HalldórssonPublish On: 2014-07-16
Therefore a collision is fatal for a barrier coverage algorithm, and must be avoided by the algorithm designer. This is precisely the reason that we ...
Author: Magnús M. Halldórsson
This book constitutes the refereed proceedings of the 21st International Colloquium on Structural Information and Communication Complexity, SIROCCO 2014, held in Takayama, Japan, in July 2014. The 24 full papers presented together with 5 invited talks were carefully reviewed and selected from 51 submissions. The focus of the colloquium is on following subjects Shared Memory and Multiparty Communication, Network Optimization, CONGEST Algorithms and Lower Bounds, Wireless networks, Aggregation and Creation Games in Networks, Patrolling and Barrier Coverage, Exploration, Rendevous and Mobile Agents.
Author: Jean-François LaslierPublish On: 2019-11-15
Communication complexity (for algorithm designers). Now Publishers. Roughgarden, T., Talgam-Cohen, I. (2015). Why prices need algorithms.
Author: Jean-François Laslier
Publisher: Springer Nature
Category: Business & Economics
This collection of essays represents responses by over eighty scholars to an unusual request: give your high level assessment of the field of economic design, as broadly construed. Where do we come from? Where do we go from here? The book editors invited short, informal reflections expressing deeply felt but hard to demonstrate opinions, unsupported speculation, and controversial views of a kind one might not normally risk submitting for review. The contributors – both senior researchers who have shaped the field and promising, younger researchers – responded with a diverse collection of provocative pieces, including: retrospective assessments or surveys of the field; opinion papers; reflections on critical points for the development of the discipline; proposals for the immediate future; "science fiction"; and many more. The readers should have fun reading these unusual pieces – as much as the contributors enjoyed writing them.
ACM, New York (2014) Roughgarden, T.: Communication complexity (for algorithm designers). arXiv preprint arXiv:1509.06257 (2015) Schrijver, ...
Author: Hans L. Bodlaender
This book constitutes the revised selected papers of the 43rd International Workshop on Graph-Theoretic Concepts in Computer Science, WG 2017, held in Eindhoven, The Netherlands, in June 2017. The 31 full papers presented in this volume were carefully reviewed and selected from 71 submissions. They cover a wide range of areas, aiming at connecting theory and applications by demonstrating how graph-theoretic concepts can be applied in various areas of computer science. Another focus is on presenting recent results and on identifying and exploring promising directions of future research.
Communication complexity (for algorithm designers). Foundations and Trends in Theoretical Computer ... Algorithmic selfassembly of DNA Sierpinski triangles.
Author: Avi Wigderson
Publisher: Princeton University Press
An introduction to computational complexity theory, its connections and interactions with mathematics, and its central role in the natural and social sciences, technology, and philosophy Mathematics and Computation provides a broad, conceptual overview of computational complexity theory—the mathematical study of efficient computation. With important practical applications to computer science and industry, computational complexity theory has evolved into a highly interdisciplinary field, with strong links to most mathematical areas and to a growing number of scientific endeavors. Avi Wigderson takes a sweeping survey of complexity theory, emphasizing the field’s insights and challenges. He explains the ideas and motivations leading to key models, notions, and results. In particular, he looks at algorithms and complexity, computations and proofs, randomness and interaction, quantum and arithmetic computation, and cryptography and learning, all as parts of a cohesive whole with numerous cross-influences. Wigderson illustrates the immense breadth of the field, its beauty and richness, and its diverse and growing interactions with other areas of mathematics. He ends with a comprehensive look at the theory of computation, its methodology and aspirations, and the unique and fundamental ways in which it has shaped and will further shape science, technology, and society. For further reading, an extensive bibliography is provided for all topics covered. Mathematics and Computation is useful for undergraduate and graduate students in mathematics, computer science, and related fields, as well as researchers and teachers in these fields. Many parts require little background, and serve as an invitation to newcomers seeking an introduction to the theory of computation. Comprehensive coverage of computational complexity theory, and beyond High-level, intuitive exposition, which brings conceptual clarity to this central and dynamic scientific discipline Historical accounts of the evolution and motivations of central concepts and models A broad view of the theory of computation's influence on science, technology, and society Extensive bibliography
While designing parallel algorithms, one has to address the following issues: ... Sometimes the communication complexity is higher than the computational ...
Author: S. K. BASU
Publisher: PHI Learning Pvt. Ltd.
The design of correct and efficient algorithms for problem solving lies at the heart of computer science. This concise text, without being highly specialized, teaches the skills needed to master the essentials of this subject. With clear explanations and engaging writing style, the book places increased emphasis on algorithm design techniques rather than programming in order to develop in the reader the problem-solving skills. The treatment throughout the book is primarily tailored to the curriculum needs of B.Tech. students in computer science and engineering, B.Sc. (Hons.) and M.Sc. students in computer science, and MCA students. The book focuses on the standard algorithm design methods and the concepts are illustrated through representative examples to offer a reader-friendly text. Elementary analysis of time complexities is provided for each example-algorithm. A varied collection of exercises at the end of each chapter serves to reinforce the principles/methods involved. New To This Edition • Additional problems • A new Chapter 14 on Bioinformatics Algorithms • The following new sections: » BSP model (Chapter 0) » Some examples of average complexity calculation (Chapter 1) » Amortization (Chapter 1) » Some more data structures (Chapter 1) » Polynomial multiplication (Chapter 2) » Better-fit heuristic (Chapter 7) » Graph matching (Chapter 9) » Function optimization, neighbourhood annealing and implicit elitism (Chapter 12) • Additional matter in Chapter 15 • Appendix
For the communication complexity, we note that in LogicalTime ME, ... The algorithm, called the Ricart AgrawalaME algorithm after its designers, ...
Author: Nancy A. Lynch
In Distributed Algorithms, Nancy Lynch provides a blueprint for designing, implementing, and analyzing distributed algorithms. She directs her book at a wide audience, including students, programmers, system designers, and researchers. Distributed Algorithms contains the most significant algorithms and impossibility results in the area, all in a simple automata-theoretic setting. The algorithms are proved correct, and their complexity is analyzed according to precisely defined complexity measures. The problems covered include resource allocation, communication, consensus among distributed processes, data consistency, deadlock detection, leader election, global snapshots, and many others. The material is organized according to the system model—first by the timing model and then by the interprocess communication mechanism. The material on system models is isolated in separate chapters for easy reference. The presentation is completely rigorous, yet is intuitive enough for immediate comprehension. This book familiarizes readers with important problems, algorithms, and impossibility results in the area: readers can then recognize the problems when they arise in practice, apply the algorithms to solve them, and use the impossibility results to determine whether problems are unsolvable. The book also provides readers with the basic mathematical tools for designing new algorithms and proving new impossibility results. In addition, it teaches readers how to reason carefully about distributed algorithms—to model them formally, devise precise specifications for their required behavior, prove their correctness, and evaluate their performance with realistic measures.
Author: Jean-Daniel BoissonnatPublish On: 2003-11-11
Communication Complexity of Multi-robot Systems Eric Klavins” California ... faced with problems similar to those of the parallel algorithm designer: If the ...
Author: Jean-Daniel Boissonnat
Category: Technology & Engineering
Selected contributions to the Workshop WAFR 2002, held December 15-17, 2002, Nice, France. This fifth biannual Workshop on Algorithmic Foundations of Robotics focuses on algorithmic issues related to robotics and automation. The design and analysis of robot algorithms raises fundamental questions in computer science, computational geometry, mechanical modeling, operations research, control theory, and associated fields. The highly selective program highlights significant new results such as algorithmic models and complexity bounds. The validation of algorithms, design concepts, or techniques is the common thread running through this focused collection.
Author: Friedhelm Meyer auf der HeidePublish On: 1996-06-26
The main idea behind lower bounds is the communication complexity of the problem being ... of the algorithm designer, but this must be specified in advance.
Author: Friedhelm Meyer auf der Heide
Publisher: Springer Science & Business Media
This volume constitutes the refereed proceedings of the 23rd International Colloquium on Automata, Languages and Programming (ICALP '96), held at Paderborn, Germany, in July 1996. ICALP is an annual conference sponsored by the European Association on Theoretical Computer Science (EATCS). The proceedings contain 52 refereed papers selected from 172 submissions and 4 invited papers. The papers cover the whole range of theoretical computer science; they are organized in sections on: Process Theory; Fairness, Domination, and the u-Calculus; Logic and Algebra; Languages and Processes; Algebraic Complexity; Graph Algorithms; Automata; Complexity Theory; Combinatorics on Words; Algorithms; Lower Bounds; Data Structures...
Since Sense of Direction is known to improve the communication complexity of distributed algorithms , computing SD as a preprocessing phase in unlabelled ...
Author: Nicola Santoro
Publisher: McGill-Queen's Press - MQUP
Category: Language Arts & Disciplines
The ultimate goal of research in Distributed Computing is to understand the nature, properties and limits of computing in a system of autonomous communicating agents. To this end, it is crucial to identify those factors which are significant for the computability and the communication complexity of problems. A crucial role is played by those factors which can be termed Structural Information: its identification, characterization, analysis, and its impact on communication complexity is an important theoretical task which has immediate practical importance. The purpose of the Colloquia on Structural Information and Communication Complexity (SIROCCO) is to focus explicitly on the interaction between structural information and communication complexity. The Colloquia comprise position papers, presentations of current research, and group discussions. Series 1 contains papers presented at the 1st Colloquium on Structural Information and Communication Complexity, held in Ottawa, Canada. Series 2 contains papers presented at the 2nd Colloquium held in Olympia, Greece.
... A.: On the asymptotic complexity of solving LWE. Des. Codes Crypt. ... T.: Communication complexity (for algorithm designers) (2015).
Author: Jonathan Katz
The three volume-set, LNCS 10401, LNCS 10402, and LNCS 10403, constitutes the refereed proceedings of the 37th Annual International Cryptology Conference, CRYPTO 2017, held in Santa Barbara, CA, USA, in August 2017. The 72 revised full papers presented were carefully reviewed and selected from 311 submissions. The papers are organized in the following topical sections: functional encryption; foundations; two-party computation; bitcoin; multiparty computation; award papers; obfuscation; conditional disclosure of secrets; OT and ORAM; quantum; hash functions; lattices; signatures; block ciphers; authenticated encryption; public-key encryption, stream ciphers, lattice crypto; leakage and subversion; symmetric-key crypto, and real-world crypto.
Communication Costs Must Be Considered It is a mistake to ignore
communication costs in determining the complexity of a parallel algorithm .
Sometimes the communication complexity is higher than the computational
complexity ; in other ...
THE COMMUNICATIONS COMPLEXITY HIERARCHY IN DISTRIBUTED COMPUTING J. B. Sidney + ... algorithm designers should consider the trade - off between the two .
Author: Eli Gafni
Publisher: McGill-Queen's Press - MQUP
This volume contains papers presented at the First International Workshop on Distributed Algorithms. The papers present solutions to a wide spectrum of problems (leader election, resource allocation, routing, etc.) and focus on a variety of issues that influence communications complexity.