[an error occurred while processing this directive] [an error occurred while processing this directive]
[an error occurred while processing this directive]
[an error occurred while processing this directive]
Monash University

FIT3143 Parallel computing - Semester 1, 2013

Modern computer systems contain parallelism in both hardware and software. This unit covers parallelism in both general purpose and application specific computer architectures and the programming paradigms that allow parallelism to be exploited in software. The unit examines both shared memory and message passing paradigms in both hardware and software; concurrency, multithreading and synchronicity; parallel, clustered and distributed supercomputing models, languages and software tools and development environments. Students will program in these paradigms.

Mode of Delivery

Clayton (Day)

Contact Hours

2 hrs lectures/wk, 2 hr laboratory/wk, 1 hr tutorial/wk

Workload requirements

This unit is offered to on-campus students.  Workload commitments per week are:

  • 2 hour lecture
  • 2 hour lab
  • 1 hour tutorial
  • minimum of 7 hours of personal study in order to satisfy the reading and assignment expectations.

Unit Relationships


FIT4001, CSE4333



Chief Examiner

Campus Lecturer


Asad Khan

Consultation hours: By appointment



Mark Gleeson

Consultation hours: By appointment

Mehran Vahid

Consultation hours: By appointment

Academic Overview

Learning Outcomes

At the completion of this unit students will have -A knowledge and understanding of:
  • a variety of parallel architectures, such as bus-based, massively parallel, cluster, vector, GPU;
  • a variety of parallel programming paradigms, synchronisation and parallelisation primitives, message passing, data parallel, tuple space;
concurrency, synchronicity and parallelism;
  • software development environments and tools (including performance tools);
  • the design issues of parallel systems.
An appreciation of:
  • the needs of parallel applications.
Developed skills in:
  • designing, developing and debugging parallel programs using a variety of paradigms;
  • measuring the performance of parallel applications and tuning implementation.

Unit Schedule

Week Activities Assessment
0 Unit Introduction on Moodle No formal assessment or activities are undertaken in week 0
1 Unit Introduction; Distributed Systems Lecture (no lab or tute)  
2 Inter Process Communications; Remote Procedure Calls Weekly lab work assessments begin in week 2
3 Message Passing Library  
4 Synchronisation, MUTEX, Deadlocks  
5 Election Algorithms, Distributed Transactions, Concurrency Control Assignment 1 due Mon 8-April-2013, 12PM (mid-day)
6 Faults, Distributed Consensus, Security, Parallel Computing  
7 Parallel Computing Alternatives  
8 Instruction Level Parallelism  
9 Vector Architecture  
10 Data Parallel Architectures, SIMD Architectures  
11 Introduction to MIMD, Distributed Memory MIMD Architectures Assignment 2 (Theory) due on 20-May-2013, 12PM (mid-day). Assignment 2 In-lab assessments
12 Super Scalar Processing, Exam Revision Assignment 2 In-lab assessments.
  SWOT VAC No formal assessment is undertaken in SWOT VAC
  Examination period LINK to Assessment Policy: http://policy.monash.edu.au/policy-bank/

*Unit Schedule details will be maintained and communicated to you via your learning system.

Assessment Summary

Examination (3 hours): 50%; In-semester assessment: 50%

Assessment Task Value Due Date
Assignment 1 15% Mon 08-April-2013, 12PM
Assignment 2 25% In-lab assessments week 11 and 12, Theory due Mon 20-May-2013, 12PM
Lab work assessments 10% Weekly submissions
Examination 1 50% To be advised

Teaching Approach

Lecture and tutorials or problem classes
This teaching and learning approach provides facilitated learning, practical exploration and peer learning.

Assessment Requirements

Assessment Policy

Faculty Policy - Unit Assessment Hurdles (http://www.infotech.monash.edu.au/resources/staff/edgov/policies/assessment-examinations/unit-assessment-hurdles.html)

Academic Integrity - Please see the Demystifying Citing and Referencing tutorial at http://lib.monash.edu/tutorials/citing/

Assessment Tasks


  • Assessment task 1
    Assignment 1
    Individual assignment. A research paper, of 3000 words, on topics selected from the weekly lectures.
    Criteria for assessment:

    The work will be assessed on the basis of the quality of the write-up (e.g. easy to read, logical and systematic presentation of concepts, formatting, figures, tables), relevance and accuracy of information, and literature search.

    Due date:
    Mon 08-April-2013, 12PM
  • Assessment task 2
    Assignment 2
    Individual assignment. The work will comprise two parallel distributed programming tasks and a 1500-word write-up. The programming tasks will be assessed in the lab class, with each student demonstrating the written programs to the tutor in week 11 and week 12. The write-up will be submitted in week 11.
    Criteria for assessment:

    Detailed marking guide will be provided with the assessment. As a general guide to assessing the programming tasks:

    1. All programs must compile and run correctly.
    2. Programs must meet the problem specification.
    3. Source code should be readable and maintainable.
    4. The underlying algorithms are clearly explained.
    5. Programs should be documented.
    Due date:
    In-lab assessments week 11 and 12, Theory due Mon 20-May-2013, 12PM
  • Assessment task 3
    Lab work assessments
    Students will complete the weekly lab and tutorial exercises in groups of 4-5 and submit their group work on weekly basis.
    Criteria for assessment:

    The assessment will be based on the demonstration of work during the lab and evidence of learning in the weekly submissions.

    The tutor will monitor individual contributions to the group when allocating marks to members of the group.

    Due date:
    Weekly submissions


  • Examination 1
    3 hours
    Type (open/closed book):
    Closed book
    Electronic devices allowed in the exam:

Learning resources

Monash Library Unit Reading List

Feedback to you

Types of feedback you can expect to receive in this unit are:
  • Informal feedback on progress in labs/tutes
  • Graded assignments with comments
  • Other: Solutions to tutes and labs

Extensions and penalties

Returning assignments

Resubmission of assignments

Resubmission of assignments, lab, and tutorial work will not be allowed.

Referencing requirements

Refer to the unit website.

Assignment submission

It is a University requirement (http://www.policy.monash.edu/policy-bank/academic/education/conduct/plagiarism-procedures.html) for students to submit an assignment coversheet for each assessment item. Faculty Assignment coversheets can be found at http://www.infotech.monash.edu.au/resources/student/forms/. Please check with your Lecturer on the submission method for your assignment coversheet (e.g. attach a file to the online assignment submission, hand-in a hard copy, or use an online quiz).

Online submission

If Electronic Submission has been approved for your unit, please submit your work via the learning system for this unit, which you can access via links in the my.monash portal.

Required Resources

Please check with your lecturer before purchasing any Required Resources. Limited copies of prescribed texts are available for you to borrow in the library, and prescribed software is available in student labs.

The standard operating environment provided in FIT computer labs is considered adequate for most purposes. However, most of the tutorial exercises require the use of an open source Linux environment, which is provided in the assigned FIT computer laboratory.

Software may be:

  • downloaded from the resources page on the unit web site
  • or purchased at academic price at good software retailers

Recommended Resources

Portable personal computer and access to a broadband Internet connection.

Other Information


Graduate Attributes Policy

Student services

Monash University Library

Disability Liaison Unit

Students who have a disability or medical condition are welcome to contact the Disability Liaison Unit to discuss academic support services. Disability Liaison Officers (DLOs) visit all Victorian campuses on a regular basis.

Your feedback to Us

Previous Student Evaluations of this Unit

Previous student feedback shows that most students, typically 50 percent or more, rated this unit very highly. There are no significant changes planned based on feedback results.

If you wish to view how previous students rated this unit, please go to


NB: Students who attend fewer than 80% of the lectures will need to rely on the reading list.

For Part 1: Parallel Computing Schemes and Software:

A.S. Tanenbaum, T. Austin: Structured Computer Organization, 6th Ed, Prentice Hall (PEARSON), 2012.

G.R. Andrews: Foundations of Multithreaded, Parallel and Distributed Programming, Addison-Wesley, 2000.

I.T. Foster: Designing and Building Parallel Programs, Addison-Wesley, 1995.

M. Maekawa, A.E. Oldehoeft, R.R. Oldehoeft: Operating Systems Advanced Concepts, Benjamin/Cummings, 1987.

For Part 2: Parallel Distributed Computing Architectures:

Advanced Computer Architectures: A Design Space Approach, Sima, Fountain and Kacsuk , Addison Wesley Publishers.

W. Stallings: Computer Organization Architecture, 9th Ed, Prentice Hall (Pearson Hall), 2013.

[an error occurred while processing this directive]