IBM Research


Software and Code  



The following code files (usually in C++ or MATLAB) have been developed during the past few years as a by-product of research.

  • The code used in the "L1-Penalized Quantile Regression in High-Dimensional Sparse Models", with Victor Chernozhukov: R code for Monte Carlo, simple MatLab implementation that requires SDPT3.

  • The code used in "High-Dimensional Sparse Econometric Models, an Introduction", with Victor Chernozhukov:Matlab Code.

  • The code used in the Supplementary Material of "Least Squares After Model Selection in High-dimensional Sparse Models," with Victor Chernozhukov: files (simulation for known standard deviation of the noise)

  • The code used in "Linear and Conic Programming Approaches to High-Dimensional Errors-in-variables Models," with M. Rosenbaum and A. Tsybakov: files (simulation for known standard deviation of the noise)

  • Square-root LASSO is a variant of LASSO that does not rely on estimates of the standard deviation of the noise:
    SqrtLasso
    Available MATLAB code:
    • coordinatewise method (file)
    • interior point methods calling SDPT3 (file)
    • first order methods calling TFOCS package:
      opts = tfocs_SCD;
      [ beta, out ] = tfocs_SCD( prox_l1(lambda/n), { X, -Y }, proj_l2(1/sqrt(n)), 1e-6 );
    • recommended choice of penalty level lambda:
      c = 1.1; ALPHA = 0.05;
      lambda = c*sqrt(n)*norminv(1 - ( ALPHA/(2*p) ), 0,1);
    • for other choices of penalty level and discussions click here.

  • Behrens-Fisher Problem: Given two independent random samples {X_i : i=1,...,N_1} and {Y_i: i=1,...,N_2} test whether their respective means coincide in the case where their covariances are unknown and potentially different. We consider the Gaussian case. BF01
    The Gaussian Maximum Likelihood Behrens–Fisher problem is given by the following non-convex problem:

    BF02

    Available MATLAB code:
    • cutting line method (two versions, with and without the use of a spectral decomposition, files)
    • Newton method combined with non-convex line search (file)
    • Iterative method (file)
    • The cutting line method is guaranteed to converge to a global solution while the iterative method can converge to a local solution.

  • Efficient Projection onto a Second Order Cone: BF01
    BF02
    Available MATLAB code:
    • specialized efficient projection (files)
    • interior point method based on SeDuMi (file)



Disclaimer:
ANY SOFTWARE ABOVE IS PROVIDED BY THE AUTHOR "AS IS". IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THE SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.



 
Additional information  

    My CV is here


                                             Publications TeachingProfessional ExperienceConferences LinksSoftware and Code