Constrained MDPs and the reward hypothesis

-
It's been a looong ago that I posted on this blog. But this should not mean the blog is dead. Slow and steady wins the race, right? Anyhow, I am back and today I want to write about constrained Markovian Decision Process (CMDPs). The post is prompted by a recent visit of Eugene Feinberg , a pioneer of CMDPs, of our department, and also by a growing interest in CMPDs in the RL community (see this , this , or this paper). For impatient readers, a CMDP is like an MDP except that there are multiple reward functions, one of which is used to set the optimization objective, while the others are used to restrict what policies can do. Now, it seems to me that more often than not the problems we want to solve are easiest to specify using multiple objectives (in fact, this is a borderline tautology!). An example, which given our current sad situation is hard to escape, is deciding what interventions a government should apply to limit the spread of a virus while maintaining economic
6 comments

How to make Thunderbird delete temporary file

-
If you are using Thunderbird (TB) on Mac OSX, you might be annoyed by that when TB opens an attachment (like a pdf file) it creates the file on the Desktop and then leaves just it there! I have finally found a solution, which seems to work at least for me and assuming that you also have Firefox. The solution is here, but I duplicate it here to make sure the idea spreads:

Simply open Firefox, in the address bar type in about:config, then add a boolean variable browser.helperApps.deleteTempFileOnExit and set its value to true.

Now, this works to the extent that when you exit Firefox(!!) (after quitting Thunderbird), it will remove the cluttering files.

Enjoy!

Comments

  1. Csaba Szepesvári7 September 2009 at 10:35

    Sorry guys, the fix does not work for some reason. It has worked first, but now it stopped working.

    ReplyDelete
  2. Girija14 October 2009 at 05:52

    Hi,

    I know very little about Mac OS but this issue seemed to be interesting and then I read your comment that it didn't work after first try. The link that you have mentioned talks about one more setting for Thunderbird. It says:
    "For Thunderbird get to the config editor via Thunderbird > Preferences… > General > Config Editor… and add the same Boolean preference"
    You haven't mentioned this in your post. So I was just wondering if you have tried this trick too?

    --
    Girija

    ReplyDelete
  3. Csaba Szepesvári14 October 2009 at 07:25

    Hi Girija,
    Yes, I looked at that.
    In my Thunderbird (2.0.0.23, latest) there is no "Config Editor.." accessible from the preferences.
    - Csaba

    ReplyDelete
  4. Girija14 October 2009 at 11:13

    Hi,

    I have Thunderbird 2.0.0.22. I found this setting under Advanced tab of Preferences. You might want to check that once.

    --
    Girija

    ReplyDelete
  5. Csaba Szepesvári14 October 2009 at 11:43

    Girija,
    Thanks, this is great: I have found this setting there, too. And what is even better is that it works again!! Perfect! Wow, you made my day!
    Thanks,
    Csaba
    PS: I will update my post later to reflect to current state of the art.

    ReplyDelete
  6. Girija14 October 2009 at 21:07

    :)
    Great to hear that! You are welcome!

    --
    Girija

    ReplyDelete
  7. thunderbird23 November 2014 at 13:06

    thanks a lot !

    3 customers asked me to solve this !

    great tips !

    Sebastien

    ReplyDelete

Post a Comment

Popular posts from this blog

Constrained MDPs and the reward hypothesis

-
Image
It's been a looong ago that I posted on this blog. But this should not mean the blog is dead. Slow and steady wins the race, right? Anyhow, I am back and today I want to write about constrained Markovian Decision Process (CMDPs). The post is prompted by a recent visit of Eugene Feinberg , a pioneer of CMDPs, of our department, and also by a growing interest in CMPDs in the RL community (see this , this , or this paper). For impatient readers, a CMDP is like an MDP except that there are multiple reward functions, one of which is used to set the optimization objective, while the others are used to restrict what policies can do. Now, it seems to me that more often than not the problems we want to solve are easiest to specify using multiple objectives (in fact, this is a borderline tautology!). An example, which given our current sad situation is hard to escape, is deciding what interventions a government should apply to limit the spread of a virus while maintaining economic
Read more

Bayesian Statistics in Medical Clinical Trials

-
I came across a very interesting document. The document is titled " Guidance for the Use of Bayesian Statistics in Medical Device Clinical Trials ". It is a draft guidelines poster by the Center for Devices and Radiological Health of FDA, dated May 23, 2006. Why is this interesting? The job of FDA (the US Food and Drug Administration) is to make sure that the decisions in any clinical trial are made in a scientifically sound manner. Clearly, when following the Bayesian approach the choice of the prior and the model can influence the decisions. What does FDA do in this situation? The establish a process where they require a pre-specification (and agreement on) both the prior and the model, including an analysis of the operating characteristics of the design. This latter includes estimating the probability of erroneously approving an ineffective or unsafe device (the Type I error). This will typically be done by conducting Monte-Carlo simulations, where the Type I error is
Read more

Keynote vs. Powerpoint vs. Beamer

-
A few days ago I decided to give Keynote , Apple's presentation software, a try (part of iWork '09). Beforehand I used MS Powerpoint 2003, Impress from NeoOffice 3.0 (OpenOffice's native Mac version) and LaTeX with beamer . Here is a comparison of the ups and downs of these software, mainly to remind myself when I will reconsider my choice in half a year and also to help people decide what to use for their presentation. Comments, suggestions, critics are absolutely welcome, as usual. Btw, while preparing this note I have learned that go-oo.org has a native Mac Aqua version of OpenOffice. Maybe I will try it some day and update the post. It would also be good to include a recent version of Powerpoint in the comparison. Stability Keynote: Excellent After a few days of usage, so take this statement with a grain of salt.. MS Powerpoint 2003: Excellent Impress: Poor Save your work very often Beamer: Excellent Creating visually appealing slides, graphics on slides Keynote: Ex
Read more