It is made up of usually cement and large bricks, sometimes marble or other stones are also used in place of bricks. No matter what that is , it should be able to withstand the heat due to fire.
Most chimneys and fireplaces are constructed of bricks, cement blocks or some types of stone. Sometimes they are a combination of these. The main consideration is the ability to withstand high heat.