Well both Joomla and WordPress are known as Content Management Systems or CMS for short. Wikipedia has a good explanation of what a CMS is here. In short it is an application used to create, manage, store and deploy content on Web pages. Web content types can include text, graphics and photos, video or audio in the form of an article or a blog.
Now Before you all freak out and say I am Joomla biased let me say you are right I do prefer Joomla but not because I am biased but because it is clearly a better more flexible environment with a much larger developer base for both free and commercial adons.
So although most will say use WordPress if you want to have a Blog and Joomla if you want a website, I say hogwash. if you want a Blog Joomla is the better product because it also gives you a way to grow add to and expand. and this way your site does not look like every other WordPress blog page out there. Lets face it why do you want to look like everyone else you want to be unique right?
So from my perspective if you want to start your first website or blog site and want to have something that will grow with you as you learn. And something that will look like a professional did it not just like another WordPress site then Joomla is by far the better choice.