Optimizing the Performance of a Pipelined Processor

1 Introduction
Inthislab,youwilllearnaboutthedesignandimplementationofapipelinedY86-64processor,optimizing both it and a benchmark program to maximize performance. You are allowed to make any semanticspreserving transformation to the benchmark program, or to make enhancements to the pipelined processor, or both. When you have completed the lab, you will have a keen appreciation for the interactions between code and hardware that affect the performance of your programs. Thelabisorganizedintothreeparts,eachwithitsownhandin. InPartAyouwillwritesomesimpleY86-64 programs and become familiar with the Y86-64 tools. In Part B, you will extend the SEQ simulator with a new instruction. These two parts will prepare you for Part C, the heart of the lab, where you will optimize the Y86-64 benchmark program and the processor design.
2 Logistics
You will work on this lab alone. Any clarifications and revisions to the assignment will be posted on the course Web page.
3 HandoutInstructions
SITE-SPECIFIC: Insert a paragraph here that explains how students should download the archlab-handout.tar file.
1. Start by copying the file archlab-handout.tar to a (protected) directory in which you plan to do your work.
1
2. Then give the command: tar xvf archlab-handout.tar. This will cause the following files to be unpacked into the directory: README, Makefile, sim.tar, archlab.pdf, and simguide.pdf.
3. Next, give the command tar xvf sim.tar. This will create the directory sim, which contains your personal copy of the Y86-64 tools. You will be doing all of your work inside this directory. 4. Finally, change to the sim directory and build the Y86-64 tools:
unix cd sim unix make clean; make
4 PartA
You will be working in directory sim/misc in this part. Your task is to write and simulate the following three Y86-64 programs. The required behavior of these programs is defined by the example C functions in examples.c. Be sure to put your name and ID in a comment at the beginning of each program. You can test your programs by first assemblying them with the program YAS and then running them with the instruction set simulator YIS. In all of your Y86-64 functions, you should follow the x86-64 conventions for passing function arguments, using registers, and using the stack. This includes saving and restoring any callee-save registers that you use.
sum.ys: Iterativelysumlinkedlistelements
Write a Y86-64 program sum.ys that iteratively sums the elements of a linked list. Your program should consist of some code that sets up the stack structure, invokes a function, and then halts. In this case, the function should be Y86-64 code for a function (sum list) that is functionally equivalent to the C sum list function in Figure 1. Test your program using the following three-element list:
# Sample linked list .align 8 ele1: .quad 0x00a .quad ele2 ele2: .quad 0x0b0 .quad ele3 ele3: .quad 0xc00 .quad 0
2
1 /* linked list element */ 2 typedef struct ELE { 3 long val; 4 struct ELE *next; 5 } *list_ptr; 6 7 /* sum_list - Sum the elements of a linked list */ 8 long sum_list(list_ptr ls) 9 { 10 long val = 0; 11 while (ls) { 12 val += ls-val; 13 ls = ls-next; 14 } 15 return val; 16 } 17 18 /* rsum_list - Recursive version of sum_list */ 19 long rsum_list(list_ptr ls) 20 { 21 if (!ls) 22 return 0; 23 else { 24 long val = ls-val; 25 long rest = rsum_list(ls-next); 26 return val + rest; 27 } 28 } 29 30 /* copy_block - Copy src to dest and return xor checksum of src */ 31 long copy_block(long *src, long *dest, long len) 32 { 33 long result = 0; 34 while (len 0) { 35 long val = *src++; 36 *dest++ = val; 37 result ˆ= val; 38 len--; 39 } 40 return result; 41 }
Figure 1: C versions of the Y86-64 solution functions. See sim/misc/examples.c
3
rsum.ys: Recursivelysumlinkedlistelements
Write a Y86-64 program rsum.ys that recursively sums the elements of a linked list. This code should be similar to the code in sum.ys, except that it should use a function rsum list that recursively sums a list of numbers, as shown with the C function rsum list in Figure 1. Test your program using the same three-element list you used for testing list.ys.
copy.ys: Copyasourceblocktoadestinationblock
Write a program (copy.ys) that copies a block of words from one part of memory to another (nonoverlapping area) area of memory, computing the checksum (Xor) of all the words copied. Your program should consist of code that sets up a stack frame, invokes a function copy block, and then halts. The function should be functionally equivalent to the C function copy block shown in Figure Figure 1. Test your program using the following three-element source and destination blocks:
.align 8 # Source block src: .quad 0x00a .quad 0x0b0 .quad 0xc00
# Destination block dest: .quad 0x111 .quad 0x222 .quad 0x333
5 PartB
You will be working in directory sim/seq in this part. YourtaskinPartBistoextendtheSEQprocessortosupportthe iaddq,describedinHomeworkproblems 4.51 and 4.52. To add this instructions, you will modify the file seq-full.hcl, which implements the versionofSEQdescribedintheCS:APP3etextbook. Inaddition,itcontainsdeclarationsofsomeconstants that you will need for your solution. Your HCL file must begin with a header comment containing the following information: • Your name and ID. • A description of the computations required for the iaddq instruction. Use the descriptions of irmovq and OPq in Figure 4.18 in the CS:APP3e text as a guide.
4
BuildingandTestingYourSolution
Once you have finished modifying the seq-full.hcl file, then you will need to build a new instance of the SEQ simulator (ssim) based on this HCL file, and then test it:
• Building a new simulator. You can use make to build a new SEQ simulator: unix make VERSION=full
This builds a version of ssim that uses the control logic you specified in seq-full.hcl. To save typing, you can assign VERSION=full in the Makefile. • Testing your solution on a simple Y86-64 program. For your initial testing, we recommend running simple programs such as asumi.yo (testing iaddq) in TTY mode, comparing the results against the ISA simulation:
unix ./ssim -t ../y86-code/asumi.yo
If the ISA test fails, then you should debug your implementation by single stepping the simulator in GUI mode:
unix ./ssim -g ../y86-code/asumi.yo • Retesting your solution using the benchmark programs. Once your simulator is able to correctly execute small programs, then you can automatically test it on the Y86-64 benchmark programs in ../y86-code:
unix (cd ../y86-code; make testssim)
Thiswillrun ssim onthebenchmarkprogramsandcheckforcorrectnessbycomparingtheresulting processorstatewiththestatefromahigh-levelISAsimulation. Notethatnoneoftheseprogramstest the added instructions. You are simply making sure that your solution did not inject errors for the original instructions. See file ../y86-code/README file for more details. • Performing regression tests. Once you can execute the benchmark programs correctly, then you should run the extensive set of regression tests in ../ptest. To test everything except iaddq and leave:
unix (cd ../ptest; make SIM=../seq/ssim)
To test your implementation of iaddq:
unix (cd ../ptest; make SIM=../seq/ssim TFLAGS=-i)
For more information on the SEQ simulator refer to the handout CS:APP3e Guide to Y86-64 Processor Simulators (simguide.pdf).
5
1 /* 2 * ncopy - copy src to dst, returning number of positive ints 3 * contained in src array. 4 */ 5 word_t ncopy(word_t *src, word_t *dst, word_t len) 6 { 7 word_t count = 0; 8 word_t val; 9 10 while (len 0) { 11 val = *src++; 12 *dst++ = val; 13 if (val 0) 14 count++; 15 len--; 16 } 17 return count; 18 }
Figure 2: C version of the ncopy function. See sim/pipe/ncopy.c.
6 PartC
You will be working in directory sim/pipe in this part. The ncopy function in Figure 2 copies a len-element integer array src to a non-overlapping dst, returning a count of the number of positive integers contained in src. Figure 3 shows the baseline Y86-64 version of ncopy. The file pipe-full.hcl contains a copy of the HCL code for PIPE, along with a declaration of the constant value IIADDQ. Your task in Part C is to modify ncopy.ys and pipe-full.hcl with the goal of making ncopy.ys run as fast as possible. Youwillbehandingintwofiles: pipe-full.hcl and ncopy.ys. Eachfileshouldbeginwithaheader comment with the following information: • Your name and ID. • A high-level description of your code. In each case, describe how and why you modified your code.
CodingRules
You are free to make any modifications you wish, with the following constraints:
• Your ncopy.ys function must work for arbitrary array sizes. You might be tempted to hardwire your solution for 64-element arrays by simply coding 64 copy instructions, but this would be a bad idea because we will be grading your solution based on its performance on arbitrary arrays.
6
1 ################################################################## 2 # ncopy.ys - Copy a src block of len words to dst. 3 # Return the number of positive words (0) contained in src. 4 # 5 # Include your name and ID here. 6 # 7 # Describe how and why you modified the baseline code. 8 # 9 ################################################################## 10 # Do not modify this portion 11 # Function prologue. 12 # %rdi = src, %rsi = dst, %rdx = len 13 ncopy: 14 15 ################################################################## 16 # You can modify this portion 17 # Loop header 18 xorq %rax,%rax # count = 0; 19 andq %rdx,%rdx # len <= 0? 20 jle Done # if so, goto Done: 21 22 Loop: mrmovq (%rdi), %r10 # read val from src... 23 rmmovq %r10, (%rsi) # ...and store it to dst 24 andq %r10, %r10 # val <= 0? 25 jle Npos # if so, goto Npos: 26 irmovq $1, %r10 27 addq %r10, %rax # count++ 28 Npos: irmovq $1, %r10 29 subq %r10, %rdx # len-30 irmovq $8, %r10 31 addq %r10, %rdi # src++ 32 addq %r10, %rsi # dst++ 33 andq %rdx,%rdx # len 0? 34 jg Loop # if so, goto Loop: 35 ################################################################## 36 # Do not modify the following section of code 37 # Function epilogue. 38 Done: 39 ret 40 ################################################################## 41 # Keep the following label at the end of your function 42 End:
Figure 3: Baseline Y86-64 version of the ncopy function. See sim/pipe/ncopy.ys.
7
• Your ncopy.ys function must run correctly with YIS. By correctly, we mean that it must correctly copy the src block and return (in %rax) the correct number of positive integers. • Theassembledversionofyourncopyfilemustnotbemorethan1000byteslong. Youcancheckthe lengthofanyprogramwiththencopyfunctionembeddedusingtheprovidedscriptcheck-len.pl:
unix ./check-len.pl < ncopy.yo • Yourpipe-full.hclimplementationmustpasstheregressiontestsin../y86-codeand../ptest (without the -i flag that tests iaddq).
Other than that, you are free to implement the iaddq instruction if you think that will help. You may make any semantics preserving transformations to the ncopy.ys function, such as reordering instructions, replacinggroups ofinstructionswithsingleinstructions, deletingsome instructions, andadding other instructions. You may find it useful to read about loop unrolling in Section 5.8 of CS:APP3e.
BuildingandRunningYourSolution
In order to test your solution, you will need to build a driver program that calls your ncopy function. We have provided you with the gen-driver.pl program that generates a driver program for arbitrary sized input arrays. For example, typing
unix make drivers
will construct the following two useful driver programs:
• sdriver.yo: Asmalldriverprogramthattestsanncopyfunctiononsmallarrayswith4elements. Ifyoursolutioniscorrect,thenthisprogramwillhaltwithavalueof2inregister %rax aftercopying the src array. • ldriver.yo: A large driver program that tests an ncopy function on larger arrays with 63 elements. If your solution is correct, then this program will halt with a value of 31 (0x1f) in register %rax after copying the src array.
Each time you modify your ncopy.ys program, you can rebuild the driver programs by typing
unix make drivers
Each time you modify your pipe-full.hcl file, you can rebuild the simulator by typing
unix make psim VERSION=full
If you want to rebuild the simulator and the driver programs, type
unix make VERSION=full
8
To test your solution in GUI mode on a small 4-element array, type
unix ./psim -g sdriver.yo
To test your solution on a larger 63-element array, type
unix ./psim -g ldriver.yo
Once your simulator correctly runs your version of ncopy.ys on these two block lengths, you will want to perform the following additional tests: • Testing your driver files on the ISA simulator. Make sure that your ncopy.ys function works properly with YIS:
unix make drivers unix ../misc/yis sdriver.yo • TestingyourcodeonarangeofblocklengthswiththeISAsimulator. ThePerlscriptcorrectness.pl generates driver files with block lengths from 0 up to some limit (default 65), plus some larger sizes. Itsimulatesthem(bydefaultwith YIS),andcheckstheresults. Itgeneratesareportshowingthestatus for each block length:
unix ./correctness.pl
This script generates test programs where the result count varies randomly from one run to another, and so it provides a more stringent test than the standard drivers. If you get incorrect results for some length K, you can generate a driver file for that length that includes checking code, and where the result varies randomly:
unix ./gen-driver.pl -f ncopy.ys -n K -rc driver.ys unix make driver.yo unix ../misc/yis driver.yo
The program will end with register %rax having the following value:
0xaaaa : All tests pass. 0xbbbb : Incorrect count 0xcccc : Function ncopy is more than 1000 bytes long. 0xdddd : Some of the source data was not copied to its destination. 0xeeee : Some word just before or just after the destination region was corrupted. • Testing your pipeline simulator on the benchmark programs. Once your simulator is able to correctly execute sdriver.ys and ldriver.ys, you should test it against the Y86-64 benchmark programs in ../y86-code:
unix (cd ../y86-code; make testpsim)
9
This will run psim on the benchmark programs and compare results with YIS. • Testing your pipeline simulator with extensive regression tests. Once you can execute the benchmark programs correctly, then you should check it with the regression tests in ../ptest. For example, if your solution implements the iaddq instruction, then
unix (cd ../ptest; make SIM=../pipe/psim TFLAGS=-i) • Testing your code on a range of block lengths with the pipeline simulator. Finally, you can run the same code tests on the pipeline simulator that you did earlier with the ISA simulator
unix ./correctness.pl -p
7 Evaluation
The lab is worth 190 points: 30 points for Part A, 60 points for Part B, and 100 points for Part C.
PartA
Part A is worth30points, 10 pointsfor each Y86-64 solution program. Eachsolution program willbeevaluatedforcorrectness,includingproperhandlingofthestackandregisters,aswellasfunctionalequivalence with the example C functions in examples.c. The programs sum.ys and rsum.ys will be considered correct if the graders do not spot any errors in them, and their respective sum list and rsum list functions return the sum 0xcba in register %rax. The program copy.ys will be considered correct if the graders do not spot any errors in them, and the copy block function returns the sum 0xcba in register %rax, copies the three 64-bit values 0x00a, 0x0b, and 0xc to the 24 bytes beginning at address dest, and does not corrupt other memory locations.
PartB
This part of the lab is worth 35 points: • 10 points for your description of the computations required for the iaddq instruction. • 10pointsforpassingthebenchmarkregressiontestsin y86-code,toverifythatyoursimulatorstill correctly executes the benchmark suite. • 15 points for passing the regression tests in ptest for iaddq.
PartC
ThispartoftheLabisworth100points: Youwillnotreceiveanycreditifeitheryourcodeforncopy.ys oryourmodifiedsimulatorfailsanyofthetestsdescribedearlier.
10
• 20 points each for your descriptions in the headers of ncopy.ys and pipe-full.hcl and the quality of these implementations. • 60 points for performance. To receive credit here, your solution must be correct, as defined earlier. That is, ncopy runs correctly with YIS, and pipe-full.hcl passes all tests in y86-code and ptest. We will express the performance of your function in units of cycles per element (CPE). That is, if the simulated code requires C cycles to copy a block of N elements, then the CPE is C/N. The PIPE simulator displays the total number of cycles required to complete the program. The baseline version ofthe ncopy functionrunningonthestandardPIPEsimulatorwithalarge63-elementarrayrequires 897 cycles to copy 63 elements, for a CPE of 897/63 = 14.24. Since some cycles are used to set up the call to ncopy and to set up the loop within ncopy, you will find that you will get different values of the CPE for different block lengths (generally the CPE willdropas N increases). Wewillthereforeevaluatetheperformanceofyourfunctionbycomputing the average of the CPEs for blocks ranging from 1 to 64 elements. You can use the Perl script benchmark.pl in the pipe directory to run simulations of your ncopy.ys code over a range of block lengths and compute the average CPE. Simply run the command
unix ./benchmark.pl
toseewhathappens. Forexample,thebaselineversionofthencopyfunctionhasCPEvaluesranging between 29.00 and 14.27, with an average of 15.18. Note that this Perl script does not check for the correctness of the answer. Use the script correctness.pl for this. You should be able to achieve an average CPE of less than 9.00. Our best version averages 7.48. If your average CPE is c, then your score S for this portion of the lab will be: S =      0, c 10.5 20·(10.5−c), 7.50 ≤ c ≤ 10.50 60, c < 7.50 By default, benchmark.pl and correctness.pl compile and test ncopy.ys. Use the -f argument to specify a different file name. The -h flag gives a complete list of the command line arguments.
8 HandinInstructions
SITE-SPECIFIC:Insertadescriptionthatexplainshowstudentsshouldhandinthethree partsofthelab. HereisthedescriptionweuseatCMU.
• You will be handing in three sets of files: – Part A: sum.ys, rsum.ys, and copy.ys. – Part B: seq-full.hcl.
11
– Part C: ncopy.ys and pipe-full.hcl. • Make sure you have included your name and ID in a comment at the top of each of your handin files. • To handin your files for part X, go to your archlab-handout directory and type: unix make handin-partX TEAM=teamname
where X is a, b, or c, and where teamname is your ID. For example, to handin Part A:
unix make handin-parta TEAM=teamname • After the handin, if you discover a mistake and want to submit a revised copy, type unix make handin-partX TEAM=teamname VERSION=2
Keep incrementing the version number with each submission. • You can verify your handin by looking in CLASSDIR/archlab/handin-partX
You have list and insert permissions in this directory, but no read or write permissions.
9 Hints • Bydesign,bothsdriver.yoandldriver.yoaresmallenoughtodebugwithinGUImode. We find it easiest to debug in GUI mode, and suggest that you use it. • If you running in GUI mode on a Unix server, make sure that you have initialized the DISPLAY environment variable:
unix setenv DISPLAY myhost.edu:0
• With some X servers, the “Program Code” window begins life as a closed icon when you run psim or ssim in GUI mode. Simply click on the icon to expand the window. • With some Microsoft Windows-based X servers, the “Memory Contents” window will not automatically resize itself. You’ll need to resize the window by hand. • The psim and ssim simulators terminate with a segmentation fault if you ask them to execute a file that is not a valid Y86-64 object file.