Computer Science and Engineering

Load-Balanced Pipeline ParallelismMd Kamruzzaman Steven Swanson Dean M. TullsenComputer Science and Engineering University of California, San Diego{mkamruzz,swanson,tullsen}@cs.ucsd.eduABSTRACT Accelerating a single thread in current parallel systems remainsa challenging problem, because sequential threads do not natu- rally take advantage of the additional cores. Recent work shows that automatic extraction of pipeline parallelism is an effective way to speed up single thread execution. However, two problems re- main challenging – load balancing and inter-thread communica- tion. This work shows new mechanism to exploit pipeline paral- lelism that naturally solves the load balancing and communication problems. This compiler-based technique automatically extracts the pipeline stages and executes them in a data parallel fashion, using token-based chunked synchronization to handle sequential stages. This technique provides linear speedup for several appli- cations, and outperforms prior techniques to exploit pipeline par- allelism by as much as 50%.Categories and Subject Descriptors D.3.4 [Programming Languages]: Processors–OptimizationGeneral Terms Languages, PerformanceKeywords pipeline parallelism, load-balancing, chip multiprocessors, locality, compilers1. INTRODUCTION The number of cores per die on multicore processors increaseswith each processor generation. However, many applications fail to scale with the increased hardware parallelism. Several factors account for this, but this research is most concerned with key ap- plications that are difficult to parallelize due to data dependences in the key loops, making the code highly sequentialPrevious work on decoupled software pipelining [18, 19, 21] ad- dresses this problem and shows that fine-grained pipeline paral- Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from SC’13, November 17–21, 2013, Denver, Colorado, USA. Copyright 2013 ACM 978-1-4503-2378-9/13/11 …$15.00. applied at the loop level can be very effective in speeding up some serial codes, including irregular codes like pointer chas- ing. In this case, the compiler automatically divides the loop into a set of pipeline stages (each stage can be sequential or parallel) and maps them to different cores to achieve parallel execution while still maintaining all the dependencies. However, several issues make the technique still challenging in practice. First, the cores of- ten remain underutilized because of the imbalance in the pipeline, sacrificing performance and wasting energy. Second, the technique sacrifices the existing locality between stages, communicating data that was originally local across cores, again sacrificing both per- formance and power/energy. Finally, the technique typically works best with the number of threads at least equal to the number of stages, requiring the compiler to know a priori the number of cores available, and causing inefficient execution when the counts do not match.This paper describes load-balanced pipeline parallelism (LBPP) which exploits the same pipeline parallelism as prior work, but assigns work to threads in a completely different manner, main- taining locality and naturally creating load balance. While prior pipeline parallelism approaches executes a different stage on each core, LBPP executes all the stages of a loop iteration on the same core, but achieves pipeline parallelism by distributing different iter- ations to the available cores and using token based synchronization to handle sequential stages. It groups together several iterations of a single stage, though, before it moves to the next stage.LBPP is inherently load-balanced, because each thread does the same work (for different iterations). It maintains locality because same-iteration communication never crosses cores. The generated code is essentially the same no matter how many cores are targeted – thus the number of stages and the thread count are decoupled and the thread count can be determined at runtime and even change dur- ing runtime. Prior techniques must recompile to perform optimally with a different core count.For more information on Computer Science and Engineering check on:

DNP Role Presentation

Don't use plagiarized sources. Get Your Custom Essay on
Computer Science and Engineering
Just from $13/Page
Order Essay
Calculate your paper price
Pages (550 words)
Approximate price: -

Why Choose Us

Quality Papers

At Acme Writers, we always aim at 100% customer satisfaction. As such, we never compromise o the quality of our homework services. Our homework helpers ensure that they craft each paper carefully to match the requirements of the instruction form.

Professional Academic Writers

With Acme Writers, every student is guaranteed high-quality, professionally written papers. We ensure that we hire individuals with high academic qualifications who can maintain our quality policy. These writers undergo further training to sharpen their writing skills, making them more competent in writing academic papers.

Affordable Prices

Our company maintains a fair pricing system for all academic writing services to ensure affordability. Our pricing system generates quotations based on the properties of individual papers.

On-Time delivery

Acme Writers guarantees all students of swift delivery of papers. We understand that time is an essential factor in the academic world. Therefore, we ensure that we deliver the paper on or before the agreed date to give students ample time for reviewing.

100% Originality

Acme Writers maintains a zero-plagiarism policy in all papers. As such, Acme Writers professional academic writers ensure that they use the students’ instructions to deliver plagiarism-free papers. We are very keen on avoiding any chance of similarities with previous papers.

Customer Support 24/7

Our customer support works around the clock to provide students with assistance or guidance at any time of the day. Students can always communicate with us through our live chat system or our email and receive instant responses. Feel free to contact us via the Chat window or support email: support@Acme Writers.

Try it now!

Calculate the price of your order

You will get a personal manager and a discount.
We'll send you the first draft for approval by at
Total price:

How it works?

Follow these simple steps to get your paper done

Place your order

Fill in the order form and provide all details of your assignment.

Proceed with the payment

Choose the payment system that suits you most.

Receive the final file

Once your paper is ready, we will email it to you.

Our Samples

Our writers complete papers strictly according to your instructions and needs, no matter what university, college, or high school you study in.

All samples
Analysis (any type)
Argumentative essays
Dissertation/Dissertation chapter
Analysis (any type)
Advantages and disadvantages of lowering the voting age to thirteen
Undergrad. (yrs 1-2)
Political science
View this sample
Argumentative essays
Is euthanasia ethical or not?
Undergrad. (yrs 3-4)
View this sample
Dissertation/Dissertation chapter
Videoconferencing as a teaching tool
Undergrad. (yrs 3-4)
View this sample

Our Homework Writing Services

Acme Writers holds a reputation for being a platform that provides high-quality homework writing services. All you need to do is provide us with all the necessary requirements of the paper and wait for quality results.


Essay Writing Services

At Acme Writers, we have highly qualified academic gurus who will offer great assistance towards completing your essays. Our homework writing service providers are well-versed with all the aspects of developing high-quality and relevant essays.


Admission and Business Papers

With Acme Writers, we will help you secure a position at your desired institution. Our essay writing services include the crafting of admissions papers. We will still help you climb your career ladder by helping you write the official papers that will help you secure a job. We will guide you on how to write an outstanding portfolio or resume.


Editing and Proofreading

Acme Writers has a professional editorial team that will help you organize your paper, paraphrase it, and eliminate any possible mistakes. Also, we will help you check on plagiarism to ensure that your final paper posses quality and originality.


Technical papers

Acme Writers harbors professional academic writers from diverse academic disciplines. As such, we can develop homework writing services in all academic areas. The simplicity or complexity of the paper does not affect the quality of homework writing services.