Introduction to scalable systems (MA721)

Course Name: 

Introduction to scalable systems


M.Tech (CDS)




Programme Core (PC)

Credits (L-T-P): 



Computer organization, Memory hierarchy, cache memory. Introduction to data structures: Stacks, Queues, Linked lists,
Graphs and Trees. Parallelization Principles: motivation, challenges, metrics, parallelization steps, data distribution.
Parallel programming Models; Parallel Programming using MPI programming, Parallel programming using Pthreads,
Parallel programming using OpenMP, GPU computing and CUDA programming. Example programs in MPI, OpenMP,
Pthreads and CUDA C Programming, Distributed Computing: Commodity cluster and cloud computing.


An Introduction to Parallel Programming. Peter S Pacheco. Publisher: Morgan Kauffman. ISBN: 978-93-80931-75-3. 2011. Parallel Computing Architecture. A Hardware/Software Approach. David Culler, Jaswant Singh. Publisher: Morgan Kauffman. ISBN: 981-4033-103. 1999. Parallel Computing. Theory and Practice. Michael J. Quinn. Publisher: Tata: McGraw-Hill. ISBN: 0-07-049546-7. 2002. Introduction to Parallel Computing. Ananth Grama, Anshul Gupta, George Karypis, Vipin Kumar. Publisher: Addison Wesley. ISBN: 0-201-64865-2. 2003. Online references for OpenMP, MPI, CUDA and Google colab


Mathematical and Computational Sciences

Contact us

Dr. P. Sam Johnson, Professor and Head
Department of MACS, NITK, Surathkal
P. O. Srinivasnagar, Mangalore - 575 025
Karnataka, India.

  • Hot line: +91-0824-2474048

Connect with us

We're on Social Networks. Follow us & get in touch.