Introduction to scalable systems (MA721)

Course Name: 

Introduction to scalable systems


M.Tech (CDS)




Programme Core (PC)

Credits (L-T-P): 



Computer organization, Memory hierarchy, cache memory. Introduction to data structures: Stacks, Queues, Linked lists,
Graphs and Trees. Parallelization Principles: motivation, challenges, metrics, parallelization steps, data distribution.
Parallel programming Models; Parallel Programming using MPI programming, Parallel programming using Pthreads,
Parallel programming using OpenMP, GPU computing and CUDA programming. Example programs in MPI, OpenMP,
Pthreads and CUDA C Programming, Distributed Computing: Commodity cluster and cloud computing.


An Introduction to Parallel Programming. Peter S Pacheco. Publisher: Morgan Kauffman. ISBN: 978-93-80931-75-3. 2011. Parallel Computing Architecture. A Hardware/Software Approach. David Culler, Jaswant Singh. Publisher: Morgan Kauffman. ISBN: 981-4033-103. 1999. Parallel Computing. Theory and Practice. Michael J. Quinn. Publisher: Tata: McGraw-Hill. ISBN: 0-07-049546-7. 2002. Introduction to Parallel Computing. Ananth Grama, Anshul Gupta, George Karypis, Vipin Kumar. Publisher: Addison Wesley. ISBN: 0-201-64865-2. 2003. Online references for OpenMP, MPI, CUDA and Google colab


Mathematical and Computational Sciences

Contact us

Dr. R. Madhusudhan , Associate Professor and Head
Department of MACS, NITK, Surathkal
P. O. Srinivasnagar, Mangalore - 575 025
Karnataka, India.

  • Hot line: +91-0824-2474048

Connect with us

We're on Social Networks. Follow us & get in touch.