We strive to integrate self-motivation into logical planning and reasoning, in a general self-motivated cognitive agent framework. Our self-motivated cognitive agents are capable of thinking ahead and planning flexibly in an incompletely known world, question-answering dialogues, mental modeling, introspection and reasoning over a substantial knowledge base, all while in unceasing pursuit of optimizing their own cumulative utility. While such agents employ reasoned exploration of feasible sequences of actions and corresponding states, they also behave opportunistically, seizing opportunities and recovering from failures, thanks to their continual plan updates and quest for rewards. Our framework allows for both specific and general (quantified) knowledge, and for epistemic predicates such as knowing-that and knowing-whether. Since realistic agents often possess incomplete knowledge of their world, the reasoning of our agents uses a prudently restricted version of the closed world assumption; this has consequences for epistemic reasoning, in particular positive and negative introspection. The planning operators allow for quantitative, gradual change and side effects such as the passage of time, changes in distances and rewards, and language production, using a uniform procedural attachment technique. Question-answering (involving introspection and reasoning) and experimental runs are shown for our particular agent ME in a simple simulated world, demonstrating the benefits of self-awareness as well as continual, deliberate and reward-driven planning.