Parallel Processing (180702) Mid Exam Syllabus

Parallel Processing (180702) Mid Semester Exam – Jan-May 2015 Syllabus

Unit – 1 Parallel Programming Platforms

Implicit Parallelism: Trends in Microprocessor Architectures, Limitations of Memory System Performance, Dichotomy of Parallel Computing Platforms, Physical Organization of Parallel Platforms, Communication Costs in Parallel Machines. Routing Mechanisms for Interconnection Networks, Impact of Process -Processor Mapping and Mapping Techniques

Unit – 2 Principles of Parallel Algorithm Design Algorithms

Preliminaries, Decomposition Techniques, Characteristics of Tasks and Interactions, Mapping Techniques for Load Balancing, Methods for Containing Interaction Overheads, Parallel Algorithm Models

Unit – 3 Basic Communication Operations, Algorithms

One-to-All Broadcast and All-to-One Reduction, All-to-All Broadcast and Reduction, All-Reduce and Prefix-Sum Operations, Scatter and Gather, All-to-All Personalized Communication, Circular Shift, Improving the Speed of Some Communication Operations

Unit – 4 Analytical Modeling of Parallel Programs

Sources of Overhead in Parallel Programs, Performance Metrics for Parallel Systems, Effect of Granularity and Data Mapping on Performance, Scalability of Parallel Systems, Minimum Execution Time and Minimum Cost-Optimal Execution Time, Asymptotic Analysis of Parallel Programs, Other Scalability Metrics

Unit – 5 Programming using the Message Passing Paradigm

      Principles of Message-Passing Programming, The Building Blocks: Send and Receive Operations, MPI:         The Message Passing Interface, Topologies and Embedding, Overlapping Communication with Computation, Collective Communication and Computation Operations, Groups and Communicators