FUEL CMS uses MySQL for the backend. However, if you are needing a library to use with your custom code, you could try something like this and place it in your application libraries folder just like any other CodeIgniter application:

http://stackoverflow.com/questions/2248789/mongodb-and-codeigniter