Syntactic completeness of proper display calculi. A recent strand of research in structural proof theory aims at exploring the notion of analytic calculi (i.e. those calculi that support general and modular proof strategies for cut elimination), and at identifying classes of logics that can be captured in terms of these calculi. In this context, Wansing introduced the notion of proper display calculi as one possible design framework for proof calculi in which the analiticity desiderata are realized in a particularly transparent way. Recently, the theory of properly displayable logics (i.e. those logics that can be equivalently presented with some proper display calculus) has been developed in connection with generalized Sahlqvist theory (aka unified correspondence). Specifically, properly displayable logics have been syntactically characterized as those axiomatized by analytic inductive axioms, which can be equivalently and algorithmically transformed into analytic structural rules so that the resulting proper display calculi enjoy a set of basic properties soundness, completeness, conservativity, cut elimination and subformula property. In this context, the proof that the given calculus is complete w.r.t. the original logic is usually carried out syntactically, i.e. by showing that a (cut free) derivation exists of each given axiom of the logic in the basic system to which the analytic structural rules algorithmically generated from the given axiom have been added. However, so far this proof strategy for syntactic completeness has been implemented on a case by case base, and not in general. In this paper, we address this gap by proving syntactic completeness for properly displayable logics in any normal (distributive) lattice expansion signature. Specifically, we show that for every analytic inductive axiom a cut free derivation can be effectively generated which has a specific shape, referred to as pre normal form.


Applying Evolutionary Algorithms Successfully A Guide Gained from Real world Applications. Metaheuristics (MHs) in general and Evolutionary Algorithms (EAs) in particular are well known tools for successful optimization of difficult problems. But when is their application meaningful and how does one approach such a project as a novice? How do you avoid beginner's mistakes or use the design possibilities of a metaheuristic search as efficiently as possible? This paper tries to give answers to these questions based on 30 years of research and application of the Evolutionary Algorithm GLEAM and its memetic extension HyGLEAM. Most of the experience gathered and discussed here can also be applied to the use of other metaheuristics such as ant algorithms or particle swarm optimization. This paper addresses users with basic knowledge of MHs in general and EAs in particular who want to apply them in an optimization project. For this purpose, a number of questions that arise in the course of such a project are addressed. At the end, some non technical project management issues are discussed, whose importance for project success is often underestimated.


CLARQ A Dynamic ARQ Solution for Ultra high Closed loop Reliability. Emerging wireless control applications demand for extremely high closed loop reliability under strict latency constraints, which the conventional Automatic Repeat reQuest (ARQ) solutions with static schedules fail to provide. To overcome this issue and enable data link layer error control for ultra reliable low latency communication (URLLC) services, we propose a novel protocol the Closed Loop ARQ (CLARQ), which forces to accomplish an information exchange round within a fixed loop back latency, and dynamically re allocates the remaining resource between uplink and downlink slots upon the result of last uplink transmission. The proposed method guarantees to meet the latency requirement, while delivering high communication reliability and power efficiency. It can be efficiently offline optimized by means of dynamic programming techniques, and is capable of real time deployment with a low cost implementation based on look up tables. Numerical evaluations have verified that CLARQ outperforms baselines with significantly improved closed loop reliability and reduced energy consumption. Especially, over a Rayleigh channel with 0dB mean SNR, it is able to provide a closed loop error rate below 1e 7 within 10ms loop back latency, which makes our proposal competitive for practical URLLC applications in future 5G and beyond networks.


A modularity comparison of Long Short Term Memory and Morphognosis neural networks. This study compares the modularity performance of two artificial neural network architectures a Long Short Term Memory (LSTM) recurrent network, and Morphognosis, a neural network based on a hierarchy of spatial and temporal contexts. Mazes are used to measure performance, defined as the ability to utilize independently learned mazes to solve mazes composed of them. A maze is a sequence of rooms connected by doors. The modular task is implemented as follows at the beginning of the maze, an initial door choice forms a context that must be retained until the end of an intervening maze, where the same door must be chosen again to reach the goal. For testing, the door association mazes and separately trained intervening mazes are presented together for the first time. While both neural networks perform well during training, the testing performance of Morphognosis is significantly better than LSTM on this modular task.


Cross Layer Network Codes for Content Delivery in Cache Enabled D2D Networks. In this paper, we consider the use of cross layer network coding (CLNC), caching, and device to device (D2D) communications to jointly optimize the delivery of a set of popular contents to a set of user devices (UDs). In the considered D2D network, a group of near by UDs cooperate with each other and use NC to combine their cached files, so as the completion time required for delivering all requested contents to all UDs is minimized. Unlike the previous work that considers only one transmitting UD at a time, our work allows multiple UDs to transmit simultaneously given the interference among the active links is small. Such configuration brings a new trade off among scheduling UDs to transmitting UDs, selecting the coding decisions and the transmission rate power. Therefore, we consider the completion time minimization problem that involves scheduling multiple transmitting UDs, determining their transmission rates powers and file combinations. The problem is shown to be intractable because it involves all future coding decisions. To tackle the problem at each transmission slot, we first design a graph called herein the D2D Rate Aware IDNC graph where its vertices have weights that judiciously balance between the rates powers of the transmitting UDs and the number of their scheduled UDs. Then, we propose an innovative and efficient CLNC solution that iteratively selects a set of transmitting UDs only if the interference caused by the transmissions of the newly selected UDs does not significantly impact the overall completion time. Simulation results show that the proposed solution offers significant completion time reduction compared with the existing algorithms.


Pushing on Text Readability Assessment A Transformer Meets Handcrafted Linguistic Features. We report two essential improvements in readability assessment 1. three novel features in advanced semantics and 2. the timely evidence that traditional ML models (e.g. Random Forest, using handcrafted features) can combine with transformers (e.g. RoBERTa) to augment model performance. First, we explore suitable transformers and traditional ML models. Then, we extract 255 handcrafted linguistic features using self developed extraction software. Finally, we assemble those to create several hybrid models, achieving state of the art (SOTA) accuracy on popular datasets in readability assessment. The use of handcrafted features help model performance on smaller datasets. Notably, our RoBERTA RF T1 hybrid achieves the near perfect classification accuracy of 99 , a 20.3 increase from the previous SOTA.


Neural Upscaling from Residue level Protein Structure Networks to Atomistic Structure. Coarse graining is a powerful tool for extending the reach of dynamic models of proteins and other biological macromolecules. Topological coarse graining, in which biomolecules or sets thereof are represented via graph structures, is a particularly useful way of obtaining highly compressed representations of molecular structure, and simulations operating via such representations can achieve substantial computational savings. A drawback of coarse graining, however, is the loss of atomistic detail an effect that is especially acute for topological representations such as protein structure networks (PSNs). Here, we introduce an approach based on a combination of machine learning and physically guided refinement for inferring atomic coordinates from PSNs. This "neural upscaling" procedure exploits the constraints implied by PSNs on possible configurations, as well as differences in the likelihood of observing different configurations with the same PSN. Using a 1 mu s atomistic molecular dynamics trajectory of A beta 1 40 , we show that neural upscaling is able to effectively recapitulate detailed structural information for intrinsically disordered proteins, being particularly successful in recovering features such as transient secondary structure. These results suggest that scalable network based models for protein structure and dynamics may be used in settings where atomistic detail is desired, with upscaling employed to impute atomic coordinates from PSNs.


On orbital stability of the physical ground states of the NLS equations. We prove orbital stability result for physical ground states of a nonlinear Schr " o dinger (NLS) equation in the sense that the set of these ground states is contained in the set of prescribed mass solutions which is orbital stable by the Cazenave Lions theorem. We apply the nonlinear generalized Rayleigh quotients method which allows establishing a one to one correspondence between the values of the mass m , the frequency lambda , and the action level S of the physical ground states.


Choice of Parallelism Multi GPU Driven Pipeline for Huge Academic Backbone Network. Science Information Network (SINET) is a Japanese academic backbone network for more than 800 research institutions and universities. In this paper, we present a multi GPU driven pipeline for handling huge session data of SINET. Our pipeline consists of ELK stack, multi GPU server, and Splunk. A multi GPU server is responsible for two procedures discrimination and histogramming. Discrimination is dividing session data into ingoing outgoing with subnet mask calculation and network address matching. Histogramming is grouping ingoing outgoing session data into bins with map reduce. In our architecture, we use GPU for the acceleration of ingress egress discrimination of session data. Also, we use a tiling design pattern for building a two stage map reduce of CPU and GPU. Our multi GPU driven pipeline has succeeded in processing huge workloads of about 1.2 to 1.6 billion session streams (500GB 650GB) within 24 hours.


Identifying the leading dynamics of ubiquitin a comparison between the tICA and the LE4PD slow fluctuations in amino acids' position. Molecular Dynamics (MD) simulations of proteins implicitly contain the information connecting the atomistic molecular structure and proteins' biologically relevant motion, where large scale fluctuations are deemed to guide folding and function. In the complex multiscale processes described by MD trajectories it is difficult to identify, separate, and study those large scale fluctuations. This problem can be formulated as the need to identify a small number of collective variables that guide the slow kinetic processes. Among the methods used to study the slow, leading processes in proteins' dynamics, the time lagged independent component analysis, or tICA, has been extensively used. Recently, we developed a Langevin coarse grained approach for the dynamics of proteins, called the Langevin Equation for Protein Dynamics or LE4PD. This approach partitions the protein's MD dynamics into uncorrelated, wavelength dependent, diffusive modes, and it associates to each mode a free energy map. In the free energy maps, we measure the spatial extension and the time evolution of the mode dependent, slow dynamical fluctuations, using the string method and a Markov state model. The theory identifies the slow collective variables in the rescaled LE4PD normal modes. Here, we compare the tICA modes' predictions with the collective LE4PD modes. We observe that the two methods consistently identify the nature and extension of the slowest fluctuation processes. The tICA separates the slow, leading processes in a smaller number of modes than the LE4PD does. However, LE4PD provides time dependent information and a formal connection to the physics of the kinetic processes missing in the pure statistical analysis of tICA.


Towards Better Adversarial Synthesis of Human Images from Text. This paper proposes an approach that generates multiple 3D human meshes from text. The human shapes are represented by 3D meshes based on the SMPL model. The model's performance is evaluated on the COCO dataset, which contains challenging human shapes and intricate interactions between individuals. The model is able to capture the dynamics of the scene and the interactions between individuals based on text. We further show how using such a shape as input to image synthesis frameworks helps to constrain the network to synthesize humans with realistic human shapes.


Self supervised Spatiotemporal Representation Learning by Exploiting Video Continuity. Recent self supervised video representation learning methods have found significant success by exploring essential properties of videos, e.g. speed, temporal order, etc. This work exploits an essential yet under explored property of videos, the video continuity, to obtain supervision signals for self supervised representation learning. Specifically, we formulate three novel continuity related pretext tasks, i.e. continuity justification, discontinuity localization, and missing section approximation, that jointly supervise a shared backbone for video representation learning. This self supervision approach, termed as Continuity Perception Network (CPNet), solves the three tasks altogether and encourages the backbone network to learn local and long ranged motion and context representations. It outperforms prior arts on multiple downstream tasks, such as action recognition, video retrieval, and action localization. Additionally, the video continuity can be complementary to other coarse grained video properties for representation learning, and integrating the proposed pretext task to prior arts can yield much performance gains.


MP RW LSH An Efficient Multi Probe LSH Solution to ANNS in L 1 Distance. Approximate Nearest Neighbor Search (ANNS) is a fundamental algorithmic problem, with numerous applications in many areas of computer science. Locality sensitive hashing (LSH) is one of the most popular solution approaches for ANNS. A common shortcoming of many LSH schemes is that since they probe only a single bucket in a hash table, they need to use a large number of hash tables to achieve a high query accuracy. For ANNS L 2 , a multi probe scheme was proposed to overcome this drawback by strategically probing multiple buckets in a hash table. In this work, we propose MP RW LSH, the first and so far only multi probe LSH solution to ANNS in L 1 distance. Another contribution of this work is to explain why a state of the art ANNS L 1 solution called Cauchy projection LSH (CP LSH) is fundamentally not suitable for multi probe extension. We show that MP RW LSH uses 15 to 53 times fewer hash tables than CP LSH for achieving similar query accuracies.


A Russo Dye type Theorem and Stinespring representation for invariant block multilinear completely positive maps. In this article, we investigate certain basic properties of invariant multilinear CP maps which hold true in the theory of CP maps between two C algebras. In some cases, results are affirmative and in some cases results are negative. For instance, we show that every invariant multilinear CP map is automatically symmetric and completely bounded. Surprisingly these results are unknown in the literature (see cite Heo 00,Heo,HJ 2019 ). As a negative result, we provide a concrete example of positive multilinear map varphi C(X) 3 to mathbb C which is not CP. We also prove Russo Dye type theorem for invariant multilinear positive maps on a commutative domain. Further, we provide a simple and independent proof of Stinespring dilation theorem for block CP maps. This generalizes the work of A. Kaplan cite AK89 . We introduce multilinear version of invariant block CP map varphi varphi ij M n ( mathcal A ) k to M n( mathcal B( H ) ) . Then we derive that each varphi ij can be dilated to a common commutative tuple of homomorphisms. This result is a generalization of J. Heo's Stinespring type dilation theorems of cite Heo99,Heo . As a special case of our result recovers a finer version of J. Heo's Stinespring type dilation theorem of cite Heo as we do not use the additional assumptions symmetric and completely bounded in the hypothesis. As a natural appeal, the suitable notion of minimality has been identified in this framework. As an application, we show Russo Dye type theorem for invariant multilinear completely positive maps.


Two level Nystr "om Schur preconditioner for sparse symmetric positive definite matrices. Randomized methods are becoming increasingly popular in numerical linear algebra. However, few attempts have been made to use them in developing preconditioners. Our interest lies in solving large scale sparse symmetric positive definite linear systems of equations where the system matrix is preordered to doubly bordered block diagonal form (for example, using a nested dissection ordering). We investigate the use of randomized methods to construct high quality preconditioners. In particular, we propose a new and efficient approach that employs Nystr "om's method for computing low rank approximations to develop robust algebraic two level preconditioners. Construction of the new preconditioners involves iteratively solving a smaller but denser symmetric positive definite Schur complement system with multiple right hand sides. Numerical experiments on problems coming from a range of application areas demonstrate that this inner system can be solved cheaply using block conjugate gradients and that using a large convergence tolerance to limit the cost does not adversely affect the quality of the resulting Nystr "om Schur two level preconditioner.


Multimodal Remote Sensing Benchmark Datasets for Land Cover Classification with A Shared and Specific Feature Learning Model. As remote sensing (RS) data obtained from different sensors become available largely and openly, multimodal data processing and analysis techniques have been garnering increasing interest in the RS and geoscience community. However, due to the gap between different modalities in terms of imaging sensors, resolutions, and contents, embedding their complementary information into a consistent, compact, accurate, and discriminative representation, to a great extent, remains challenging. To this end, we propose a shared and specific feature learning (S2FL) model. S2FL is capable of decomposing multimodal RS data into modality shared and modality specific components, enabling the information blending of multi modalities more effectively, particularly for heterogeneous data sources. Moreover, to better assess multimodal baselines and the newly proposed S2FL model, three multimodal RS benchmark datasets, i.e., Houston2013 hyperspectral and multispectral data, Berlin hyperspectral and synthetic aperture radar (SAR) data, Augsburg hyperspectral, SAR, and digital surface model (DSM) data, are released and used for land cover classification. Extensive experiments conducted on the three datasets demonstrate the superiority and advancement of our S2FL model in the task of land cover classification in comparison with previously proposed state of the art baselines. Furthermore, the baseline codes and datasets used in this paper will be made available freely at https github.com danfenghong ISPRS S2FL.


Tell me what you see A zero shot action recognition method based on natural language descriptions. Recently, several approaches have explored the detection and classification of objects in videos to perform Zero Shot Action Recognition with remarkable results. In these methods, class object relationships are used to associate visual patterns with the semantic side information because these relationships also tend to appear in texts. Therefore, word vector methods would reflect them in their latent representations. Inspired by these methods and by video captioning's ability to describe events not only with a set of objects but with contextual information, we propose a method in which video captioning models, called observers, provide different and complementary descriptive sentences. We demonstrate that representing videos with descriptive sentences instead of deep features, in ZSAR, is viable and naturally alleviates the domain adaptation problem, as we reached state of the art (SOTA) performance on the UCF101 dataset and competitive performance on HMDB51 without their training sets. We also demonstrate that word vectors are unsuitable for building the semantic embedding space of our descriptions. Thus, we propose to represent the classes with sentences extracted from documents acquired with search engines on the Internet, without any human evaluation on the quality of descriptions. Lastly, we build a shared semantic space employing BERT based embedders pre trained in the paraphrasing task on multiple text datasets. We show that this pre training is essential for bridging the semantic gap. The projection onto this space is straightforward for both types of information, visual and semantic, because they are sentences, enabling the classification with nearest neighbour rule in this shared space. Our code is available at https github.com valterlej zsarcap.


Identity Aware CycleGAN for Face Photo Sketch Synthesis and Recognition. Face photo sketch synthesis and recognition has many applications in digital entertainment and law enforcement. Recently, generative adversarial networks (GANs) based methods have significantly improved the quality of image synthesis, but they have not explicitly considered the purpose of recognition. In this paper, we first propose an Identity Aware CycleGAN (IACycleGAN) model that applies a new perceptual loss to supervise the image generation network. It improves CycleGAN on photo sketch synthesis by paying more attention to the synthesis of key facial regions, such as eyes and nose, which are important for identity recognition. Furthermore, we develop a mutual optimization procedure between the synthesis model and the recognition model, which iteratively synthesizes better images by IACycleGAN and enhances the recognition model by the triplet loss of the generated and real samples. Extensive experiments are performed on both photo tosketch and sketch to photo tasks using the widely used CUFS and CUFSF databases. The results show that the proposed method performs better than several state of the art methods in terms of both synthetic image quality and photo sketch recognition accuracy.


Organic single crystal phototransistors Recent approaches and achievements. Organic phototransistors (OPTs), compared to traditional inorganic counterparts, have attracted a great deal of interest because of their inherent flexibility, light weight, easy and low cost fabrication, and are considered as potential candidates for next generation wearable electronics. Currently, significant advances have been made in OPTs with the development of new organic semiconductors and optimization of device fabrication protocols. Among various types of OPTs, small molecule organic single crystal phototransistors (OSCPTs) standout because of their exciting features, such as long exciton diffusion length and high charge carrier mobility relative to organic thinfilm phototransistors. In this review, a brief introduction to device architectures, working mechanisms and figure of merits for OPTs is presented. We then overview recent approaches employed and achievements made for the development of OSCPTs. Finally, we spotlight potential future directions to tackle the existing challenges in this field and accelerate the advancement of OSCPTs towards practical applications.


A reinforcement learning approach to resource allocation in genomic selection. Genomic selection (GS) is a technique that plant breeders use to select individuals to mate and produce new generations of species. Allocation of resources is a key factor in GS. At each selection cycle, breeders are facing the choice of budget allocation to make crosses and produce the next generation of breeding parents. Inspired by recent advances in reinforcement learning for AI problems, we develop a reinforcement learning based algorithm to automatically learn to allocate limited resources across different generations of breeding. We mathematically formulate the problem in the framework of Markov Decision Process (MDP) by defining state and action spaces. To avoid the explosion of the state space, an integer linear program is proposed that quantifies the trade off between resources and time. Finally, we propose a value function approximation method to estimate the action value function and then develop a greedy policy improvement technique to find the optimal resources. We demonstrate the effectiveness of the proposed method in enhancing genetic gain using a case study with realistic data.


More Than Meets the Eye Self Supervised Depth Reconstruction From Brain Activity. In the past few years, significant advancements were made in reconstruction of observed natural images from fMRI brain recordings using deep learning tools. Here, for the first time, we show that dense 3D depth maps of observed 2D natural images can also be recovered directly from fMRI brain recordings. We use an off the shelf method to estimate the unknown depth maps of natural images. This is applied to both (i) the small number of images presented to subjects in an fMRI scanner (images for which we have fMRI recordings referred to as "paired" data), and (ii) a very large number of natural images with no fMRI recordings ("unpaired data"). The estimated depth maps are then used as an auxiliary reconstruction criterion to train for depth reconstruction directly from fMRI. We propose two main approaches Depth only recovery and joint image depth RGBD recovery. Because the number of available "paired" training data (images with fMRI) is small, we enrich the training data via self supervised cycle consistent training on many "unpaired" data (natural images depth maps without fMRI). This is achieved using our newly defined and trained Depth based Perceptual Similarity metric as a reconstruction criterion. We show that predicting the depth map directly from fMRI outperforms its indirect sequential recovery from the reconstructed images. We further show that activations from early cortical visual areas dominate our depth reconstruction results, and propose means to characterize fMRI voxels by their degree of depth information tuning. This work adds an important layer of decoded information, extending the current envelope of visual brain decoding capabilities.


Representing Numbers in NLP a Survey and a Vision. NLP systems rarely give special consideration to numbers found in text. This starkly contrasts with the consensus in neuroscience that, in the brain, numbers are represented differently from words. We arrange recent NLP work on numeracy into a comprehensive taxonomy of tasks and methods. We break down the subjective notion of numeracy into 7 subtasks, arranged along two dimensions granularity (exact vs approximate) and units (abstract vs grounded). We analyze the myriad representational choices made by 18 previously published number encoders and decoders. We synthesize best practices for representing numbers in text and articulate a vision for holistic numeracy in NLP, comprised of design trade offs and a unified evaluation.


Microscopic derivation of a traffic flow model with a bifurcation. The goal of the paper is a rigorous derivation of a macroscopic traffic flow model with a bifurcation or a local perturbation from a microscopic one. The microscopic model is a simple follow the leader with random parameters. The random parameters are used as a statistical description of the road taken by a vehicle and its law of motion. The limit model is a deterministic and scalar Hamilton Jacobi on a network with a flux limiter, the flux limiter describing how much the bifurcation or the local perturbation slows down the vehicles. The proof of the existence of this flux limiter the first one in the context of stochastic homogenization relies on a concentration inequality and on a delicate derivation of a superadditive inequality.


Brazilian Favela Women How Your Standard Solutions for Technology Abuse Might Actually Harm Them. Brazil is home to over 200M people, the majority of which have access to the Internet. Over 11M Brazilians live in favelas, or informal settlements with no outside government regulation, often ruled by narcos or militias. Victims of intimate partner violence (IPV) in these communities are made extra vulnerable not only by lack of access to resources, but by the added layer of violence caused by criminal activity and police confrontations. In this paper, we use an unintended harms framework to analyze the unique online privacy needs of favela women and present research questions that we urge tech abuse researchers to consider.


Improving the List Decoding Version of the Cyclically Equivariant Neural Decoder. The cyclically equivariant neural decoder was recently proposed in Chen Ye, International Conference on Machine Learning, 2021 to decode cyclic codes. In the same paper, a list decoding procedure was also introduced for two widely used classes of cyclic codes BCH codes and punctured Reed Muller (RM) codes. While the list decoding procedure significantly improves the Frame Error Rate (FER) of the cyclically equivariant neural decoder, the Bit Error Rate (BER) of the list decoding procedure is even worse than the unique decoding algorithm when the list size is small. In this paper, we propose an improved version of the list decoding algorithm for BCH codes and punctured RM codes. Our new proposal significantly reduces the BER while maintaining the same (in some cases even smaller) FER. More specifically, our new decoder provides up to 2 dB gain over the previous list decoder when measured by BER, and the running time of our new decoder is 15 smaller. Code available at https github.com improvedlistdecoder code


Slot Self Attentive Dialogue State Tracking. An indispensable component in task oriented dialogue systems is the dialogue state tracker, which keeps track of users' intentions in the course of conversation. The typical approach towards this goal is to fill in multiple pre defined slots that are essential to complete the task. Although various dialogue state tracking methods have been proposed in recent years, most of them predict the value of each slot separately and fail to consider the correlations among slots. In this paper, we propose a slot self attention mechanism that can learn the slot correlations automatically. Specifically, a slot token attention is first utilized to obtain slot specific features from the dialogue context. Then a stacked slot self attention is applied on these features to learn the correlations among slots. We conduct comprehensive experiments on two multi domain task oriented dialogue datasets, including MultiWOZ 2.0 and MultiWOZ 2.1. The experimental results demonstrate that our approach achieves state of the art performance on both datasets, verifying the necessity and effectiveness of taking slot correlations into consideration.


Topological properties on isochronous centers of polynomial Hamiltonian differential systems. In this paper, we study the topological properties of complex polynomial Hamiltonian differential systems of degree n having an isochronous center of Morse type. Firstly, we prove that if the critical level curve possessing an isochronous center contains only a single singular point, then the vanishing cycle associated to this center represents a zero homology cycle on the compact Riemann surface of a generic level curve. Our result provides a positive answer to a question asked by L. Gavrilov under a quite simple condition and can be applied to achieve an equivalent description of the Jacobian conjecture on mathbb C 2 . Secondly, we obtain a very simple but useful necessary condition for isochronicity of Hamiltonian systems, which is that the (n 1) degree part of the Hamiltonian function must have a factor with multipicity no less than (n 1) 2 . Thirdly, we show a relation between Gavrilov's question and the conjecture proposed by X. Jarque and J. Villadelprat on the non isochronicity of real Hamiltonian systems of even degree n .


Classification of animal sounds in a hyperdiverse rainforest using Convolutional Neural Networks. To protect tropical forest biodiversity, we need to be able to detect it reliably, cheaply, and at scale. Automated species detection from passively recorded soundscapes via machine learning approaches is a promising technique towards this goal, but it is constrained by the necessity of large training data sets. Using soundscapes from a tropical forest in Borneo and a Convolutional Neural Network model (CNN) created with transfer learning, we investigate i) the minimum viable training data set size for accurate prediction of call types ('sonotypes'), and ii) the extent to which data augmentation can overcome the issue of small training data sets. We found that even relatively high sample sizes ( 80 per call type) lead to mediocre accuracy, which however improves significantly with data augmentation, including at extremely small sample sizes, regardless of taxonomic group or call characteristics. Our results suggest that transfer learning and data augmentation can make the use of CNNs to classify species' vocalizations feasible even for small soundscape based projects with many rare species. Our open source method has the potential to enable conservation initiatives become more evidence based by using soundscape data in the adaptive management of biodiversity.


Global stability analysis and direct numerical simulation of boundary layers with an isolated roughness element. Global stability analysis and direct numerical simulation (DNS) are performed to study boundary layer flows with an isolated roughness element. Wall attached cuboids with aspect ratios eta 1 and eta 0.5 are investigated for fixed ratio of roughness height to displacement boundary layer thickness h delta 2.86 . Global stability analysis is able to capture the frequency of the primary vortical structures. For eta 1 , only varicose instability is seen. For the thinner roughness element ( eta 0.5 ), the varicose instability dominates the sinuous instability, and the sinuous instability becomes more pronounced as Re h increases, due to increased spanwise shear in the near wake region. The unstable modes mainly extract energy from the central streak, although the lateral streaks also contribute. The DNS results show that different instability features lead to different behavior and development of vortical structures in the nonlinear transition process. For eta 1 , the varicose mode is associated with the shedding of hairpin vortices. As Re h increases, the breakdown of hairpin vortices occurs closer to the roughness and sinuous breakdown behavior promoting transition to turbulence is seen in the farther wake. A fully developed turbulent flow is established in both the inner and outer layers farther downstream when Re h is sufficiently high. For eta 0.5 , the sinuous wiggling of hairpin vortices is prominent at higher Re h , leading to stronger interactions in the near wake, as a result of combined varicose and sinuous instabilities. A sinuous mode captured by dynamic mode decomposition (DMD) analysis, and associated with the wiggling' of streaks persists far downstream.


Angular deviations From a cubic equation to a universal closed formula to determine the peak position of reflected and (upper) transmitted beams. Angular deviations and lateral displacements are optical effects widely investigated in literature. In this paper, by using the Taylor expansion of the Fresnel coefficients, we obtain an analytic expression for the beam reflected by and (upper) transmitted through a dielectric prism. These analytical approximations lead to a cubic equation which allows to determine the angular deviations of the optical beams. Near the Brewster angles, under specific conditions, we obtain a universal formulation for the cubic equation. Its explicit solution determines the peak position of the reflected and (upper) transmitted beams. The universal solution could be of great utility in future experimental implementations. The analytic results show an excellent agreement with the numerical calculation and the analytic expressions given for the reflected and (upper) transmitted beams should play an important role in the weak measurements analysis.


PnPOOD Out Of Distribution Detection for Text Classification via Plug andPlay Data Augmentation. While Out of distribution (OOD) detection has been well explored in computer vision, there have been relatively few prior attempts in OOD detection for NLP classification. In this paper we argue that these prior attempts do not fully address the OOD problem and may suffer from data leakage and poor calibration of the resulting models. We present PnPOOD, a data augmentation technique to perform OOD detection via out of domain sample generation using the recently proposed Plug and Play Language Model (Dathathri et al., 2020). Our method generates high quality discriminative samples close to the class boundaries, resulting in accurate OOD detection at test time. We demonstrate that our model outperforms prior models on OOD sample detection, and exhibits lower calibration error on the 20 newsgroup text and Stanford Sentiment Treebank dataset (Lang, 1995 Socheret al., 2013). We further highlight an important data leakage issue with datasets used in prior attempts at OOD detection, and share results on a new dataset for OOD detection that does not suffer from the same problem.


Training the trainer Professional Development for High School Physics Teachers with Low Physics Background. The shortage of highly qualified high school physics teachers is a national problem. The Mitchell Institute Physics Enhancement Program (MIPEP) is a two week professional development program for in service high school physics teachers with a limited background in the subject area. MIPEP, which started in 2012, includes intense training in both subject matter and research based instructional strategies. Content and materials used in the program fulfill state curriculum requirements. The MIPEP curriculum is taught by Texas A M University faculty from the Department of Physics Astronomy along with two master high school physics teachers. In this paper we present the design and implementation of MIPEP. We report on assessment of knowledge and confidence of 2014 2018 MIPEP cohorts. We also present the results of the 2020 program that was delivered remotely due to the pandemic. Analysis of these assessments showed that the majority of MIPEP participants increased their physics knowledge and their confidence in that knowledge during both traditional and virtual program deliveries.


Can a regulatory risk measure induce profit maximizing risk capital allocations? The case of Conditional Tail Expectation. Risk capital allocations (RCAs) are an important tool in quantitative risk management, where they are utilized to, e.g., gauge the profitability of distinct business units, determine the price of a new product, and conduct the marginal economic capital analysis. Nevertheless, the notion of RCA has been living in the shadow of another, closely related notion, of risk measure (RM) in the sense that the latter notion often shapes the fashion in which the former notion is implemented. In fact, as the majority of the RCAs known nowadays are induced by RMs, the popularity of the two are apparently very much correlated. As a result, it is the RCA that is induced by the Conditional Tail Expectation (CTE) RM that has arguably prevailed in scholarly literature and applications. Admittedly, the CTE RM is a sound mathematical object and an important regulatory RM, but its appropriateness is controversial in, e.g., profitability analysis and pricing. In this paper, we address the question as to whether or not the RCA induced by the CTE RM may concur with alternatives that arise from the context of profit maximization. More specifically, we provide exhaustive description of all those probabilistic model settings, in which the mathematical and regulatory CTE RM may also reflect the risk perception of a profit maximizing insurer.


Multilayer Lookahead a Nested Version of Lookahead. In recent years, SGD and its variants have become the standard tool to train Deep Neural Networks. In this paper, we focus on the recently proposed variant Lookahead, which improves upon SGD in a wide range of applications. Following this success, we study an extension of this algorithm, the emph Multilayer Lookahead optimizer, which recursively wraps Lookahead around itself. We prove the convergence of Multilayer Lookahead with two layers to a stationary point of smooth non convex functions with O( frac 1 sqrt T ) rate. We also justify the improved generalization of both Lookahead over SGD, and of Multilayer Lookahead over Lookahead, by showing how they amplify the implicit regularization effect of SGD. We empirically verify our results and show that Multilayer Lookahead outperforms Lookahead on CIFAR 10 and CIFAR 100 classification tasks, and on GANs training on the MNIST dataset.


Learning Shared Semantic Space for Speech to Text Translation. Having numerous potential applications and great impact, end to end speech translation (ST) has long been treated as an independent task, failing to fully draw strength from the rapid advances of its sibling text machine translation (MT). With text and audio inputs represented differently, the modality gap has rendered MT data and its end to end models incompatible with their ST counterparts. In observation of this obstacle, we propose to bridge this representation gap with Chimera. By projecting audio and text features to a common semantic representation, Chimera unifies MT and ST tasks and boosts the performance on ST benchmarks, MuST C and Augmented Librispeech, to a new state of the art. Specifically, Chimera obtains 27.1 BLEU on MuST C EN DE, improving the SOTA by a 1.9 BLEU margin. Further experimental analyses demonstrate that the shared semantic space indeed conveys common knowledge between these two tasks and thus paves a new way for augmenting training resources across modalities. Code, data, and resources are available at https github.com Glaciohound Chimera ST.


Construction of Diffeomorphisms with Prescribed Jacobian Determinant and Curl. The variational principle (VP) is designed to generate non folding grids (diffeomorphisms) with prescribed Jacobian determinant (JD) and curl. Its solution pool of the original VP is based on an additive formulation and, consequently, is not invariant in the diffeomorphic Lie algebra. The original VP works well when the prescribed pair of JD and curl is calculated from a diffeomorphism, but not necessarily when the prescribed JD and curl are not known to come from a diffeomorphism. This issue is referred as the mismatched pair problem. In spite of that, the original VP works effectively in 2D grid generations. To resolve these issues, in this paper, we describe a new version of VP (revised VP), which is based on composition of transformations and, therefore, is invariant in the Lie algebra. The revised VP seems have overcome the inaccuracy of original VP in 3D grid generations. In the following sections, the mathematical derivations are presented. It is shown that the revised VP can calculate the inverse transformation of a known diffeomorphism. Its inverse consistency and transitivity of transformations are also demonstrated numerically. Moreover, a computational strategy is formulated based on the new version of VP to handle the mismatch issue and is demonstrated with preliminary result.


Privacy preserving Federated Adversarial Domain Adaption over Feature Groups for Interpretability. We present a novel privacy preserving federated adversarial domain adaptation approach ( textbf PrADA ) to address an under studied but practical cross silo federated domain adaptation problem, in which the party of the target domain is insufficient in both samples and features. We address the lack of feature issue by extending the feature space through vertical federated learning with a feature rich party and tackle the sample scarce issue by performing adversarial domain adaptation from the sample rich source party to the target party. In this work, we focus on financial applications where interpretability is critical. However, existing adversarial domain adaptation methods typically apply a single feature extractor to learn feature representations that are low interpretable with respect to the target task. To improve interpretability, we exploit domain expertise to split the feature space into multiple groups that each holds relevant features, and we learn a semantically meaningful high order feature from each feature group. In addition, we apply a feature extractor (along with a domain discriminator) for each feature group to enable a fine grained domain adaptation. We design a secure protocol that enables performing the PrADA in a secure and efficient manner. We evaluate our approach on two tabular datasets. Experiments demonstrate both the effectiveness and practicality of our approach.


Towards Improving Embedding Based Models of Social Network Alignment via Pseudo Anchors. Social network alignment aims at aligning person identities across social networks. Embedding based models have been shown effective for the alignment where the structural proximity preserving objective is typically adopted for the model training. With the observation that overly close'' user embeddings are unavoidable for such models causing alignment inaccuracy, we propose a novel learning framework which tries to enforce the resulting embeddings to be more widely apart among the users via the introduction of carefully implanted pseudo anchors. We further proposed a meta learning algorithm to guide the updating of the pseudo anchor embeddings during the learning process. The proposed intervention via the use of pseudo anchors and meta learning allows the learning framework to be applicable to a wide spectrum of network alignment methods. We have incorporated the proposed learning framework into several state of the art models. Our experimental results demonstrate its efficacy where the methods with the pseudo anchors implanted can outperform their counterparts without pseudo anchors by a fairly large margin, especially when there only exist very few labeled anchors.


An Experimental and Comparative Benchmark Study Examining Resource Utilization in Managed Hadoop Context. Transitioning cloud based Hadoop from IaaS to PaaS, which are commercially conceptualized as pay as you go or pay per use, often reduces the associated system costs. However, managed Hadoop systems do present a black box behavior to the end users who cannot be clear on the inner performance dynamics, hence, on the benefits of leveraging them. In the study, we aimed to understand managed Hadoop context in terms of resource utilization. We utilized three experimental Hadoop on PaaS proposals as they come out of the box and conducted Hadoop specific workloads of the HiBench Benchmark Suite. During the benchmark executions, we collected system resource utilization data on the worker nodes. The results indicated that the same property specifications among cloud services do not guarantee nearby performance outputs, nor consistent results within themselves. We assume that the managed systems' architectures and pre configurations play a significant role in the performance.


Global existence of small displacement solutions for Hookean incompressible viscoelasticity in 3D. The initial value problem for Hookean incompressible viscoelastictic motion in three space dimensions has global strong solutions with small displacements.


Travelling Wakefield Tube THz Source Powered by Nonrelativistic Electron Beam. High peak power, tunable, narrowband terahertz emitters are becoming sought after given their portability, efficiency, and ability to be deployed in the field for industrial, medical, and military applications. The use of accelerator systems producing THz frequencies via Cherenkov radiation, generated by passing an electron beam through a slow wave wakefield structure, is a promising method to meet future THz requirements. To date, efforts have been dedicated to analysis and design of sources utilizing laser seeded bunched electron beam drivers with relativistic energies beyond 5 MeV. Presented here is a wakefield THz generation scheme based on passing a long quasi dc nonrelativistic beam (200 keV) through a dielectric loaded travelling wave structure. Reduced energy allows for compactness and portability of the accelerator as the size and weight of the dielectric slow wave structure is vanishingly small compared to the accelerator unit. The presented scheme can serve as a tunable high peak power THz source operated between 0.4 1.6 THz and produces power gain by a factor of five with an average efficiency of 6.8 .


Proof of the zeroth law of turbulence in one dimensional compressible magnetohydrodynamics and shock heating. The zeroth law is one of the oldest conjecture in turbulence that is still unproven. Here, we consider weak solutions of one dimensional compressible magnetohydrodynamics and demonstrate that the lack of smoothness of the fields introduces a new dissipative term, named inertial dissipation, into the expression of energy conservation that is neither viscous nor resistive in nature. We propose exact solutions assuming that the kinematic viscosity and the magnetic diffusivity are equal, and we demonstrate that the associated inertial dissipation is positive and equal on average to the mean viscous dissipation rate in the limit of small viscosity, proving the conjecture of the zeroth law of turbulence and the existence of an anomalous dissipation. As an illustration, we evaluate the shock heating produced by discontinuities detected by Voyager in the solar wind around 5 AU. We deduce a heating rate of sim 10 18 J m 3 s 1 , which is significantly higher than the value obtained from the turbulent fluctuations. This suggests that collisionless shocks can be a dominant source of heating in the outer solar wind.


Ordinal Pooling. In the framework of convolutional neural networks, downsampling is often performed with an average pooling, where all the activations are treated equally, or with a max pooling operation that only retains an element with maximum activation while discarding the others. Both of these operations are restrictive and have previously been shown to be sub optimal. To address this issue, a novel pooling scheme, named emph ordinal pooling , is introduced in this work. Ordinal pooling rearranges all the elements of a pooling region in a sequence and assigns a different weight to each element based upon its order in the sequence. These weights are used to compute the pooling operation as a weighted sum of the rearranged elements of the pooling region. They are learned via a standard gradient based training, allowing to learn a behavior anywhere in the spectrum of average pooling to max pooling in a differentiable manner. Our experiments suggest that it is advantageous for the networks to perform different types of pooling operations within a pooling layer and that a hybrid behavior between average and max pooling is often beneficial. More importantly, they also demonstrate that ordinal pooling leads to consistent improvements in the accuracy over average or max pooling operations while speeding up the training and alleviating the issue of the choice of the pooling operations and activation functions to be used in the networks. In particular, ordinal pooling mainly helps on lightweight or quantized deep learning architectures, as typically considered e.g. for embedded applications.


An Objective Metric for Explainable AI How and Why to Estimate the Degree of Explainability. Numerous government initiatives (e.g. the EU with GDPR) are coming to the conclusion that the increasing complexity of modern software systems must be contrasted with some Rights to Explanation and metrics for the Impact Assessment of these tools, that allow humans to understand and oversee the output of Automated Decision Making systems. Explainable AI was born as a pathway to allow humans to explore and understand the inner working of complex systems. But establishing what is an explanation and objectively evaluating explainability, are not trivial tasks. With this paper, we present a new model agnostic metric to measure the Degree of eXplainability of (correct) information in an objective way, exploiting a specific theoretical model from Ordinary Language Philosophy called the Achinstein's Theory of Explanations, implemented with an algorithm relying on deep language models for knowledge graph extraction and information retrieval. In order to understand whether this metric is actually behaving as explainability is expected to, we have devised a few experiments and user studies involving more than 160 participants evaluating two realistic AI based systems for healthcare and finance using famous AI technology including Artificial Neural Networks and TreeSHAP. The results we obtained are very encouraging, suggesting that our proposed metric for measuring the Degree of eXplainability is robust on several scenarios and it can be eventually exploited for a lawful Impact Assessment of an Automated Decision Making system.


Probabilistic Data with Continuous Distributions. Statistical models of real world data typically involve continuous probability distributions such as normal, Laplace, or exponential distributions. Such distributions are supported by many probabilistic modelling formalisms, including probabilistic database systems. Yet, the traditional theoretical framework of probabilistic databases focusses entirely on finite probabilistic databases. Only recently, we set out to develop the mathematical theory of infinite probabilistic databases. The present paper is an exposition of two recent papers which are cornerstones of this theory. In (Grohe, Lindner ICDT 2020) we propose a very general framework for probabilistic databases, possibly involving continuous probability distributions, and show that queries have a well defined semantics in this framework. In (Grohe, Kaminski, Katoen, Lindner PODS 2020) we extend the declarative probabilistic programming language Generative Datalog, proposed by (B 'ar 'any et al. 2017) for discrete probability distributions, to continuous probability distributions and show that such programs yield generative models of continuous probabilistic databases.


Weak approximation for homogeneous spaces over some two dimensional geometric global fields. In this article, we study obstructions to weak approximation for connected linear groups and homogeneous spaces with connected or abelian stabilizers over finite extensions of mathbb C((x,y)) or function fields of curves over mathbb C((t)) . We show that for connected linear groups, the usual Brauer Manin obstruction works as in the case of tori. However, this Brauer Manin obstruction is not enough for homogeneous spaces, as shown by the examples we give. We then construct an obstruction using torsors under quasi trivial tori that explains the failure of weak approximation.


UACANet Uncertainty Augmented Context Attention for Polyp Segmentation. We propose Uncertainty Augmented Context Attention network (UACANet) for polyp segmentation which consider a uncertain area of the saliency map. We construct a modified version of U Net shape network with additional encoder and decoder and compute a saliency map in each bottom up stream prediction module and propagate to the next prediction module. In each prediction module, previously predicted saliency map is utilized to compute foreground, background and uncertain area map and we aggregate the feature map with three area maps for each representation. Then we compute the relation between each representation and each pixel in the feature map. We conduct experiments on five popular polyp segmentation benchmarks, Kvasir, CVC ClinicDB, ETIS, CVC ColonDB and CVC 300, and achieve state of the art performance. Especially, we achieve 76.6 mean Dice on ETIS dataset which is 13.8 improvement compared to the previous state of the art method. Source code is publicly available at https github.com plemeri UACANet


Equity Linked Life Insurances on Maximum of Several Assets. This paper presents pricing and hedging methods for segregated funds and unit linked life insurance products that are based on a Bayesian Markov Switching Vector Autoregressive (MS VAR) process. Here we assumed that a regime switching process is generated by a homogeneous Markov process. An advantage of our model is it depends on economic variables and is not complicated.


Accelerated Sparse Neural Training A Provable and Efficient Method to Find N M Transposable Masks. Unstructured pruning reduces the memory footprint in deep neural networks (DNNs). Recently, researchers proposed different types of structural pruning intending to reduce also the computation complexity. In this work, we first suggest a new measure called mask diversity which correlates with the expected accuracy of the different types of structural pruning. We focus on the recently suggested N M fine grained block sparsity mask, in which for each block of M weights, we have at least N zeros. While N M fine grained block sparsity allows acceleration in actual modern hardware, it can be used only to accelerate the inference phase. In order to allow for similar accelerations in the training phase, we suggest a novel transposable fine grained sparsity mask, where the same mask can be used for both forward and backward passes. Our transposable mask guarantees that both the weight matrix and its transpose follow the same sparsity pattern thus, the matrix multiplication required for passing the error backward can also be accelerated. We formulate the problem of finding the optimal transposable mask as a minimum cost flow problem. Additionally, to speed up the minimum cost flow computation, we also introduce a fast linear time approximation that can be used when the masks dynamically change during training. Our experiments suggest a 2x speed up in the matrix multiplications with no accuracy degradation over vision and language models. Finally, to solve the problem of switching between different structure constraints, we suggest a method to convert a pre trained model with unstructured sparsity to an N M fine grained block sparsity model with little to no training. A reference implementation can be found at https github.com papers submission structured transposable masks.


Towards a Scalable Hierarchical High order CFD Solver. Development of highly scalable and robust algorithms for large scale CFD simulations has been identified as one of the key ingredients to achieve NASA's CFD Vision 2030 goals. In order to improve simulation capability and to effectively leverage new high performance computing hardware, the most computationally intensive parts of CFD solution algorithms namely, linear solvers and preconditioners need to achieve asymptotic behavior on massively parallel and heterogeneous architectures and preserve convergence rates as the meshes are refined further. In this work, we present a scalable high order implicit Discontinuous Galerkin solver from the SU2 framework using a promising preconditioning technique based on algebraic sparsified nested dissection algorithm with low rank approximations, and communication avoiding Krylov subspace methods to enable scalability with very large processor counts. The overall approach is tested on a canonical 2D NACA0012 test case of increasing size to demonstrate its scalability on multiple processing cores. Both the preconditioner and the linear solver are shown to exhibit near linear weak scaling up to 2,048 cores with no significant degradation of the convergence rate.


More models of walks avoiding a quadrant (extended abstract). We continue the enumeration of plane lattice paths avoiding the negative quadrant initiated by the first author in Bousquet M 'e lou, 2016 . We solve in detail a new case, the king walks, where all 8 nearest neighbour steps are allowed. As in the two cases solved in Bousquet M 'e lou, 2016 , the associated generating function is proved to differ from a simple, explicit D finite series (related to the enumeration of walks confined to the first quadrant) by an algebraic one. The principle of the approach is the same as in Bousquet M 'e lou, 2016 , but challenging theoretical and computational difficulties arise as we now handle algebraic series of larger degree. We also explain why we expect the observed algebraicity phenomenon to persist for 4 more models, for which the quadrant problem is solvable using the reflection principle.


Parametrised moduli spaces of surfaces as infinite loop spaces. We study the E 2 algebra Lambda mathfrak M ,1 coprod g geqslant 0 Lambda mathfrak M g,1 consisting of free loop spaces of moduli spaces of Riemann surfaces with one parametrised boundary component, and compute the homotopy type of the group completion Omega B Lambda mathfrak M ,1 it is the product of Omega infty mathbf MTSO (2) with a certain free Omega infty space depending on the family of all boundary irreducible mapping classes in all mapping class groups Gamma g,n with g geqslant 0 and n geqslant 1 .


Multi color balance for color constancy. In this paper, we propose a novel multi color balance adjustment for color constancy. The proposed method, called "n color balancing," allows us not only to perfectly correct n target colors on the basis of corresponding ground truth colors but also to correct colors other than the n colors. In contrast, although white balancing can perfectly adjust white, colors other than white are not considered in the framework of white balancing in general. In an experiment, the proposed multi color balancing is demonstrated to outperform both conventional white and multi color balance adjustments including Bradford's model.


Digital Contact Tracing for Covid 19. The COVID19 pandemic created a worldwide emergency as it is estimated that such a large number of infections are due to human to human transmission of the COVID19. As a necessity, there is a need to track users who came in contact with users having travel history, asymptomatic and not yet symptomatic, but they can be in the future. To solve this problem, the present work proposes a solution for contact tracing based on assisted GPS and cloud computing technologies. An application is developed to collect each user's assisted GPS coordinates once all the users install this application. This application periodically sends assisted GPS data to the cloud. To determine which devices are within the permissible limit of 5m, we perform clustering over assisted GPS coordinates and track the clusters for about t mins to allow the measure of spread. We assume that it takes around 3 or 5 mins to get the virus from an infected object. For clustering, the proposed M way like tree data structure stores the assisted GPS coordinates in degree, minute, and second format. Thus, every user is mapped to a leaf node of the tree. We split the "seconds" part of the assisted GPS location into m equal parts, which amount to d meter in latitude(longitude). Hence, two users who are within d meter range will map to the same leaf node. Thus, by mapping assisted GPS locations every t mins, we can find out how many users came in contact with a particular user for at least t mins. Our work's salient feature is that it runs in linear time O(n) for n users in the static case, i.e., when users are not moving. We also propose a variant of our solution to handle the dynamic case, that is, when users are moving. Besides, the proposed solution offers potential hotspot detection and safe route recommendation as an additional feature, and proof of concept is presented through experiments on simulated data of 10M users.


Reviving Frequentism. Philosophers now seem to agree that frequentism is an untenable strategy to explain the meaning of probabilities. Nevertheless, I want to revive frequentism, and I will do so by grounding probabilities on typicality in the same way as the thermodynamic arrow of time can be grounded on typicality within statistical mechanics. This account, which I will call typicality frequentism, will evade the major criticisms raised against previous forms of frequentism. In this theory, probabilities arise within a physical theory from statistical behavior of almost all initial conditions. The main advantage of typicality frequentism is that it shows which kinds of probabilities (that also have empirical relevance) can be derived from physics. Although one cannot recover all probability talk in this account, this is rather a virtue than a vice, because it shows which types of probabilities can in fact arise from physics and which types need to be explained in different ways, thereby opening the path for a pluralistic account of probabilities.


More Efficient Exploration with Symbolic Priors on Action Sequence Equivalences. Incorporating prior knowledge in reinforcement learning algorithms is mainly an open question. Even when insights about the environment dynamics are available, reinforcement learning is traditionally used in a tabula rasa setting and must explore and learn everything from scratch. In this paper, we consider the problem of exploiting priors about action sequence equivalence that is, when different sequences of actions produce the same effect. We propose a new local exploration strategy calibrated to minimize collisions and maximize new state visitations. We show that this strategy can be computed at little cost, by solving a convex optimization problem. By replacing the usual epsilon greedy strategy in a DQN, we demonstrate its potential in several environments with various dynamic structures.


IDR Self Supervised Image Denoising via Iterative Data Refinement. The lack of large scale noisy clean image pairs restricts supervised denoising methods' deployment in actual applications. While existing unsupervised methods are able to learn image denoising without ground truth clean images, they either show poor performance or work under impractical settings (e.g., paired noisy images). In this paper, we present a practical unsupervised image denoising method to achieve state of the art denoising performance. Our method only requires single noisy images and a noise model, which is easily accessible in practical raw image denoising. It performs two steps iteratively (1) Constructing a noisier noisy dataset with random noise from the noise model (2) training a model on the noisier noisy dataset and using the trained model to refine noisy images to obtain the targets used in the next round. We further approximate our full iterative method with a fast algorithm for more efficient training while keeping its original high performance. Experiments on real world, synthetic, and correlated noise show that our proposed unsupervised denoising approach has superior performances over existing unsupervised methods and competitive performance with supervised methods. In addition, we argue that existing denoising datasets are of low quality and contain only a small number of scenes. To evaluate raw image denoising performance in real world applications, we build a high quality raw image dataset SenseNoise 500 that contains 500 real life scenes. The dataset can serve as a strong benchmark for better evaluating raw image denoising. Code and dataset will be released at https github.com zhangyi 3 IDR


A cubic ring of integers with the smallest Pythagoras number. We prove that the ring of integers in the totally real cubic subfield K (49) of the cyclotomic field mathbb Q ( zeta 7) has Pythagoras number equal to 4 . This is the smallest possible value for a totally real number field of odd degree. Moreover, we determine which numbers are sums of integral squares in this field, and use this knowledge to construct a diagonal universal quadratic form in five variables.


An Enriched Galerkin Method for the Stokes Equations. We present a new enriched Galerkin (EG) scheme for the Stokes equations based on piecewise linear elements for the velocity unknowns and piecewise constant elements for the pressure. The proposed EG method augments the conforming piecewise linear space for velocity by adding an additional degree of freedom which corresponds to one discontinuous linear basis function per element. Thus, the total number of degrees of freedom is significantly reduced in comparison with standard conforming, non conforming, and discontinuous Galerkin schemes for the Stokes equation. We show the well posedness of the new EG approach and prove that the scheme converges optimally. For the solution of the resulting large scale indefinite linear systems we propose robust block preconditioners, yielding scalable results independent of the discretization and physical parameters. Numerical results confirm the convergence rates of the discretization and also the robustness of the linear solvers for a variety of test problems.


Queue Learning A Reinforcement Learning Approach for Providing Quality of Service. End to end delay is a critical attribute of quality of service (QoS) in application domains such as cloud computing and computer networks. This metric is particularly important in tandem service systems, where the end to end service is provided through a chain of services. Service rate control is a common mechanism for providing QoS guarantees in service systems. In this paper, we introduce a reinforcement learning based (RL based) service rate controller that provides probabilistic upper bounds on the end to end delay of the system, while preventing the overuse of service resources. In order to have a general framework, we use queueing theory to model the service systems. However, we adopt an RL based approach to avoid the limitations of queueing theoretic methods. In particular, we use Deep Deterministic Policy Gradient (DDPG) to learn the service rates (action) as a function of the queue lengths (state) in tandem service systems. In contrast to existing RL based methods that quantify their performance by the achieved overall reward, which could be hard to interpret or even misleading, our proposed controller provides explicit probabilistic guarantees on the end to end delay of the system. The evaluations are presented for a tandem queueing system with non exponential inter arrival and service times, the results of which validate our controller's capability in meeting QoS constraints.


The fragmentation equation with size diffusion Small and large size behavior of stationary solutions. The small and large size behavior of stationary solutions to the fragmentation equation with size diffusion is investigated. It is shown that these solutions behave like stretched exponentials for large sizes, the exponent in the exponential being solely given by the behavior of the overall fragmentation rate at infinity. In contrast, the small size behavior is partially governed by the daughter fragmentation distribution and is at most linear, with possibly non algebraic behavior. Explicit solutions are also provided for particular fragmentation coefficients.


Pathologies du groupe des classes de R 'equivalence d'un groupe alg 'ebrique lin 'eaire. Let k 0 be a field of characteristic p 0 and k k 0(t) , where t is transcendental over k 0 . We give an example of a smooth connected unipotent k group G such that G(F) R is non commutative for some finite separable field extension F containing k .


Toward Safe Integration of Legacy SCADA Systems in the Smart Grid. A SCADA system is a distributed network of cyber physical devices used for instrumentation and control of critical infrastructures such as an electric power grid. With the emergence of the smart grid, SCADA systems are increasingly required to be connected to more open systems and security becomes crucial. However, many of these SCADA systems have been deployed for decades and were initially not designed with security in mind. In particular, the field devices in these systems are vulnerable to false command injection from an intruding or compromised device. But implementing cryptographic defence on these old generation devices is challenging due to their computation constraints. As a key requirement, solutions to protect legacy SCADA systems have to be an add on. This paper discusses two add on defence strategies for legacy SCADA systems the data diode and the detect and respond approach and compares their security guarantees and applicable scenarios. A generic architectural framework is also proposed to implement the detect and respond strategy, with an instantiation to demonstrate its practicality.


The complexity of the Quantified CSP having the polynomially generated powers property. It is known that if an algebra of polymorphisms of the constraint language has the Polynomially Generated Powers (PGP) Property then the Quantified CSP can be reduced to the CSP over the same constraint language with constants. The only limitation of this reduction is that it is applicable only for the constraint languages with constants. We drastically simplified the reduction and generalized it for constraint languages without constants. As a result, we completely classified the complexity of the QCSP for constraint languages having the PGP property.


Exponentiable Lie Backlund vector fields in J infty( mathbb R n, mathbb R m) . We characterize Lie Backlund vector fields in infinite dimensional jet bundles J infty( mathbb R n, mathbb R m) that can be exponentiated to flows with each component depending on a finite set of variables. We show that for m 1 each such field is an extension of one in a finite dimensional jet space. For m 1 this is no longer the case and we give necessary and sufficient conditions for exponentiation. Non trivial examples are provided for (n,m) (1,2) .


A reduced parallel transport equation on Lie Groups with a left invariant metric. This paper presents a derivation of the parallel transport equation expressed in the Lie algebra of a Lie group endowed with a left invariant metric.The use of this equation is exemplified on the group of rigid body motions SE(3), using basic numerical integration schemes, and compared to the pole ladder algorithm. This results in a stable and efficient implementation of parallel transport. The implementation leverages the python package geomstats and is available online.


Fast Quasi Geostrophic Magneto Coriolis Modes in the Earth's core. Fast changes of Earth's magnetic field could be explained by inviscid and diffusion less quasi geostrophic (QG) Magneto Coriolis modes. We present a hybrid QG model with columnar flows and three dimensional magnetic fields and find modes with periods of a few years at parameters relevant to Earth's core. For the simple poloidal magnetic field that we consider here they show a localization of kinetic and magnetic energy in the equatorial region. This concentration of energy near the equator and the high frequency make them a plausible mechanism to explain similar features observed in recent geomagnetic field observations. Our model potentially opens a way to probe the otherwise inaccessible magnetic field structure in the Earth's outer core.


Balanced Allocations Caching and Packing, Twinning and Thinning. We consider the sequential allocation of m balls (jobs) into n bins (servers) by allowing each ball to choose from some bins sampled uniformly at random. The goal is to maintain a small gap between the maximum load and the average load. In this paper, we present a general framework that allows us to analyze various allocation processes that slightly prefer allocating into underloaded, as opposed to overloaded bins. Our analysis covers several natural instances of processes, including The Caching process (a.k.a. memory protocol) as studied by Mitzenmacher, Prabhakar and Shah (2002) At each round we only take one bin sample, but we also have access to a cache in which the most recently used bin is stored. We place the ball into the least loaded of the two. The Packing process At each round we only take one bin sample. If the load is below some threshold (e.g., the average load), then we place as many balls until the threshold is reached otherwise, we place only one ball. The Twinning process At each round, we only take one bin sample. If the load is below some threshold, then we place two balls otherwise, we place only one ball. The Thinning process as recently studied by Feldheim and Gurel Gurevich (2021) At each round, we first take one bin sample. If its load is below some threshold, we place one ball otherwise, we place one ball into a textit second bin sample. As we demonstrate, our general framework implies for all these processes a gap of mathcal O ( log n) between the maximum load and average load, even when an arbitrary number of balls m geq n are allocated (heavily loaded case). Our analysis is inspired by a previous work of Peres, Talwar and Wieder (2010) for the (1 beta) process, however here we rely on the interplay between different potential functions to prove stabilization.


DVFL A Vertical Federated Learning Method for Dynamic Data. Federated learning, which solves the problem of data island by connecting multiple computational devices into a decentralized system, has become a promising paradigm for privacy preserving machine learning. This paper studies vertical federated learning (VFL), which tackles the scenarios where collaborating organizations share the same set of users but disjoint features. Contemporary VFL methods are mainly used in static scenarios where the active party and the passive party have all the data from the beginning and will not change. However, the data in real life often changes dynamically. To alleviate this problem, we propose a new vertical federation learning method, DVFL, which adapts to dynamic data distribution changes through knowledge distillation. In DVFL, most of the computations are held locally to improve data security and model efficiency. Our extensive experimental results show that DVFL can not only obtain results close to existing VFL methods in static scenes, but also adapt to changes in data distribution in dynamic scenarios.


The Surprising Effectiveness of PPO in Cooperative, Multi Agent Games. Proximal Policy Optimization (PPO) is a popular on policy reinforcement learning algorithm but is significantly less utilized than off policy learning algorithms in multi agent settings. This is often due the belief that on policy methods are significantly less sample efficient than their off policy counterparts in multi agent problems. In this work, we investigate Multi Agent PPO (MAPPO), a variant of PPO which is specialized for multi agent settings. Using a 1 GPU desktop, we show that MAPPO achieves surprisingly strong performance in three popular multi agent testbeds the particle world environments, the Starcraft multi agent challenge, and the Hanabi challenge, with minimal hyperparameter tuning and without any domain specific algorithmic modifications or architectures. In the majority of environments, we find that compared to off policy baselines, MAPPO achieves strong results while exhibiting comparable sample efficiency. Finally, through ablation studies, we present the implementation and algorithmic factors which are most influential to MAPPO's practical performance.


Ultrametrics and complete multipartite graphs. We describe the class of graphs for which all metric spaces with diametrical graphs belonging to this class are ultrametric. It is shown that a metric space (X, d) is ultrametric iff the diametrical graph of the metric d varepsilon (x, y) max d(x, y), varepsilon is either empty or complete multipartite for every varepsilon 0 . A refinement of the last result is obtained for totally bounded spaces. Moreover, using complete multipartite graphs we characterize the compact ultrametrizable topological spaces. The bounded ultrametric spaces, which are weakly similar to unbounded ones, are also characterized via complete multipartite graphs.


TweetPap A Dataset to Study the Social Media Discourse of Scientific Papers. Nowadays, researchers have moved to platforms like Twitter to spread information about their ideas and empirical evidence. Recent studies have shown that social media affects the scientific impact of a paper. However, these studies only utilize the tweet counts to represent Twitter activity. In this paper, we propose TweetPap, a large scale dataset that introduces temporal information of citation tweets and the metadata of the tweets to quantify and understand the discourse of scientific papers on social media. The dataset is publicly available at https github.com lingo iitgn TweetPap


Black Feminist Musings on Algorithmic Oppression. This paper unapologetically reflects on the critical role that Black feminism can and should play in abolishing algorithmic oppression. Positioning algorithmic oppression in the broader field of feminist science and technology studies, I draw upon feminist philosophical critiques of science and technology and discuss histories and continuities of scientific oppression against historically marginalized people. Moreover, I examine the concepts of invisibility and hypervisibility in oppressive technologies a l 'a the canonical double bind. Furthermore, I discuss what it means to call for diversity as a solution to algorithmic violence, and I critique dialectics of the fairness, accountability, and transparency community. I end by inviting you to envision and imagine the struggle to abolish algorithmic oppression by abolishing oppressive systems and shifting algorithmic development practices, including engaging our communities in scientific processes, centering marginalized communities in design, and consensual data and algorithmic practices.


Nonground Abductive Logic Programming with Probabilistic Integrity Constraints. Uncertain information is being taken into account in an increasing number of application fields. In the meantime, abduction has been proved a powerful tool for handling hypothetical reasoning and incomplete knowledge. Probabilistic logical models are a suitable framework to handle uncertain information, and in the last decade many probabilistic logical languages have been proposed, as well as inference and learning systems for them. In the realm of Abductive Logic Programming (ALP), a variety of proof procedures have been defined as well. In this paper, we consider a richer logic language, coping with probabilistic abduction with variables. In particular, we consider an ALP program enriched with integrity constraints a la IFF, possibly annotated with a probability value. We first present the overall abductive language, and its semantics according to the Distribution Semantics. We then introduce a proof procedure, obtained by extending one previously presented, and prove its soundness and completeness.


Leveraging Documentation to Test Deep Learning Library Functions. It is integral to test API functions of widely used deep learning (DL) libraries. The effectiveness of such testing requires DL specific input constraints of these API functions. Such constraints enable the generation of valid inputs, i.e., inputs that follow these DL specific constraints, to explore deep to test the core functionality of API functions. Existing fuzzers have no knowledge of such constraints, and existing constraint extraction techniques are ineffective for extracting DL specific input constraints. To fill this gap, we design and implement a document guided fuzzing technique, D2C, for API functions of DL libraries. D2C leverages sequential pattern mining to generate rules for extracting DL specific constraints from API documents and uses these constraints to guide the fuzzing to generate valid inputs automatically. D2C also generates inputs that violate these constraints to test the input validity checking code. In addition, D2C uses the constraints to generate boundary inputs to detect more bugs. Our evaluation of three popular DL libraries (TensorFlow, PyTorch, and MXNet) shows that D2C's accuracy in extracting input constraints is 83.3 to 90.0 . D2C detects 121 bugs, while a baseline fuzzer without input constraints detects only 68 bugs. Most (89) of the 121 bugs are previously unknown, 54 of which have been fixed or confirmed by developers after we report them. In addition, D2C detects 38 inconsistencies within documents, including 28 that are fixed or confirmed after we report them.


On the collapsing of Calabi Yau manifolds and K "ahler Ricci flows. We study the collapsing of Calabi Yau metrics and of Kahler Ricci flows on fiber spaces where the base is smooth. We identify the collapsed Gromov Hausdorff limit of the Kahler Ricci flow when the divisorial part of the discriminant locus has simple normal crossings. In either setting, we also obtain an explicit bound for the real codimension 2 Hausdorff measure of the Cheeger Colding singular set, and identify a sufficient condition from birational geometry to understand the metric behavior of the limiting metric on the base.


The Bicycle Network Improvement Problem Optimization Algorithms and A Case Study in Atlanta. Using a bicycle for commuting is still uncommon in US cities, although it brings many benefits to both the cyclists and to society as a whole. Cycling has the potential to reduce traffic congestion and emissions, increase mobility, and improve public health. To convince people to commute by bike, the infrastructure plays an important role, since safety is one of the primary concerns of potential cyclists. This paper presents a method to find the best way to improve the safety of a bicycle network for a given budget and maximize the number of riders that could now choose bicycles for their commuting needs. This optimization problem is formalized as the Bicycle Network Improvement Problem (BNIP) it selects which roads to improve for a set of traveler origin destination pairs, taking both safety and travel distance into account. The BNIP is modeled as a mixed integer linear program that minimizes a piecewise linear penalty function of route deviations of travelers. The MIP is solved using Benders decomposition to scale to large instances. The paper also presents an in depth case study for the Midtown area in Atlanta, GA, using actual transportation data. The results show that the Benders decomposition algorithm allows for solving realistic problem instances and that the network improvements may significantly increase the share of bicycles as the commuting mode.


Brill Noether loci with ramification at two points. We prove the injectivity of the Petri map for linear series on a general curve with given ramification at two generic points. We also describe the components of such a set of linear series on a chain of elliptic curves.


Fano fourfolds of K3 type. We produce a list of 64 families of Fano fourfolds of K3 type, extracted from our database of at least 634 Fano fourfolds constructed as zero loci of general global sections of completely reducible homogeneous vector bundles on products of flag manifolds. We study the geometry of these Fano fourfolds in some detail, and we find the origin of their K3 structure by relating most of them either to cubic fourfolds, Gushel Mukai fourfolds, or actual K3 surfaces. Their main invariants and some information on their rationality and on possible semiorthogonal decompositions for their derived categories are provided.


Unsupervised Abstractive Opinion Summarization by Generating Sentences with Tree Structured Topic Guidance. This paper presents a novel unsupervised abstractive summarization method for opinionated texts. While the basic variational autoencoder based models assume a unimodal Gaussian prior for the latent code of sentences, we alternate it with a recursive Gaussian mixture, where each mixture component corresponds to the latent code of a topic sentence and is mixed by a tree structured topic distribution. By decoding each Gaussian component, we generate sentences with tree structured topic guidance, where the root sentence conveys generic content, and the leaf sentences describe specific topics. Experimental results demonstrate that the generated topic sentences are appropriate as a summary of opinionated texts, which are more informative and cover more input contents than those generated by the recent unsupervised summarization model (Bra v z inskas et al., 2020). Furthermore, we demonstrate that the variance of latent Gaussians represents the granularity of sentences, analogous to Gaussian word embedding (Vilnis and McCallum, 2015).


Self Supervised Image to Text and Text to Image Synthesis. A comprehensive understanding of vision and language and their interrelation are crucial to realize the underlying similarities and differences between these modalities and to learn more generalized, meaningful representations. In recent years, most of the works related to Text to Image synthesis and Image to Text generation, focused on supervised generative deep architectures to solve the problems, where very little interest was placed on learning the similarities between the embedding spaces across modalities. In this paper, we propose a novel self supervised deep learning based approach towards learning the cross modal embedding spaces for both image to text and text to image generations. In our approach, we first obtain dense vector representations of images using StackGAN based autoencoder model and also dense vector representations on sentence level utilizing LSTM based text autoencoder then we study the mapping from embedding space of one modality to embedding space of the other modality utilizing GAN and maximum mean discrepancy based generative networks. We, also demonstrate that our model learns to generate textual description from image data as well as images from textual data both qualitatively and quantitatively.


RoFL Attestable Robustness for Secure Federated Learning. Even though recent years have seen many attacks exposing severe vulnerabilities in federated learning (FL), a holistic understanding of what enables these attacks and how they can be mitigated effectively is still lacking. In this work we demystify the inner workings of existing targeted attacks. We provide new insights into why these attacks are possible and why a definitive solution to FL robustness is challenging. We show that the need for ML algorithms to memorize tail data has significant implications for FL integrity. This phenomenon has largely been studied in the context of privacy our analysis sheds light on its implications for ML integrity. In addition, we show how constraints on client updates can effectively improve robustness. To incorporate these constraints into secure FL protocols, we design and develop RoFL, a new secure FL system that enables constraints to be expressed and enforced on high dimensional encrypted model updates. In essence, RoFL augments existing secure FL aggregation protocols with zero knowledge proofs. Due to the scale of FL, realizing these checks efficiently presents a paramount challenge. We introduce several optimizations at the ML layer that allow us to reduce the number of cryptographic checks needed while preserving the effectiveness of our defenses. We show that RoFL scales to the sizes of models used in real world FL deployments.


A partial uniqueness result and an asymptotically sharp nonuniqueness result for the Zhikov problem on the torus. We consider the stationary diffusion equation mathrm div ( nabla u bu ) f in n dimensional torus mathbb T n , where f in H 1 is a given forcing and b in L p is a divergence free drift. Zhikov (Funkts. Anal. Prilozhen., 2004) considered this equation in the case of a bounded, Lipschitz domain Omega subset mathbb R n , and proved existence of solutions for b in L 2n (n 2) , uniqueness for b in L 2 , and has provided a point singularity counterexample that shows nonuniqueness for b in L 3 2 and n 3,4,5 . We apply a duality method and a DiPerna Lions type estimate to show uniqueness of the solutions constructed by Zhikov for b in W 1,1 . We use a Nash iteration to demonstrate sharpness of this result, and also show that solutions in H 1 cap L p (p 1) are flexible for b in L p , p in 1,2(n 1) (n 1)) namely we show that the set of b in L p for which nonuniqueness in the class H 1 cap L p (p 1) occurs is dense in the divergence free subspace of L p .


Spectral theory of weighted hypergraphs via tensors. One way to study an hypergraph is to attach to it a tensor. Tensors are a generalization of matrices, and they are an efficient way to encode information in a compact form. In this paper we study how properties of weighted hypergraphs are reflected on eigenvalues and eigenvectors of their associated tensors. We also show how to efficiently compute eingenvalues with some techniques from numerical algebraic geometry.


Finite Time Complexity of Online Primal Dual Natural Actor Critic Algorithm for Constrained Markov Decision Processes. We consider a discounted cost constrained Markov decision process (CMDP) policy optimization problem, in which an agent seeks to maximize a discounted cumulative reward subject to a number of constraints on discounted cumulative utilities. To solve this constrained optimization program, we study an online actor critic variant of a classic primal dual method where the gradients of both the primal and dual functions are estimated using samples from a single trajectory generated by the underlying time varying Markov processes. This online primal dual natural actor critic algorithm maintains and iteratively updates three variables a dual variable (or Lagrangian multiplier), a primal variable (or actor), and a critic variable used to estimate the gradients of both primal and dual variables. These variables are updated simultaneously but on different time scales (using different step sizes) and they are all intertwined with each other. Our main contribution is to derive a finite time analysis for the convergence of this algorithm to the global optimum of a CMDP problem. Specifically, we show that with a proper choice of step sizes the optimality gap and constraint violation converge to zero in expectation at a rate mathcal O (1 K 1 6 ) , where K is the number of iterations. To our knowledge, this paper is the first to study the finite time complexity of an online primal dual actor critic method for solving a CMDP problem. We also validate the effectiveness of this algorithm through numerical simulations.


Transliteration of Foreign Words in Burmese. This manuscript provides general descriptions on transliteration of foreign words in the Burmese language. Phenomena caused by phonetic and orthographic issues are discussed. Based on this work, we expect to gradually establish prescriptive guidelines to normalize the transliteration on modern words in Burmese.


Climate Invariant Machine Learning. Data driven algorithms, in particular neural networks, can emulate the effects of unresolved processes in coarse resolution climate models when trained on high resolution simulation data however, they often make large generalization errors when evaluated in conditions they were not trained on. Here, we propose to physically rescale the inputs and outputs of machine learning algorithms to help them generalize to unseen climates. Applied to offline parameterizations of subgrid scale thermodynamics in three distinct climate models, we show that rescaled or "climate invariant" neural networks make accurate predictions in test climates that are 4K and 8K warmer than their training climates. Additionally, "climate invariant" neural nets facilitate generalization between Aquaplanet and Earth like simulations. Through visualization and attribution methods, we show that compared to standard machine learning models, "climate invariant" algorithms learn more local and robust relations between storm scale convection, radiation, and their synoptic thermodynamic environment. Overall, these results suggest that explicitly incorporating physical knowledge into data driven models of Earth system processes can improve their consistency and ability to generalize across climate regimes.


Pareto optimal and popular house allocation with lower and upper quotas. In the house allocation problem with lower and upper quotas, we are given a set of applicants and a set of projects. Each applicant has a strictly ordered preference list over the projects, while the projects are equipped with a lower and an upper quota. A feasible matching assigns the applicants to the projects in such a way that a project is either matched to no applicant or to a number of applicants between its lower and upper quota. In this model we study two classic optimality concepts Pareto optimality and popularity. We show that finding a popular matching is hard even if the maximum lower quota is 2 and that finding a perfect Pareto optimal matching, verifying Pareto optimality, and verifying popularity are all NP complete even if the maximum lower quota is 3. We complement the last three negative results by showing that the problems become polynomial time solvable when the maximum lower quota is 2, thereby answering two open questions of Cechl 'arov 'a and Fleiner. Finally, we also study the parameterized complexity of all four mentioned problems.