I want to display all my contacts/specific group map in front end of Joomla website. is this possible ?
Yes, this is possible.
Have a look at "How to create member listings/directories/maps" on my post on profiles: https://aghstrategies.com/content/civicrm-profiles-beyond-contributions-registrations-part-1