Glivenko Cantelli classes and NIP formulas. We give several new equivalences of NIP for formulas and new proofs of known results using T87 and HOR91 . We emphasize that Keisler measures are more complicated than types (even in NIP context), in an analytic sense. Among other things, we show that, for a first order theory T and formula phi(x,y) , the following are equivalent (i) phi has NIP (for theory T ). (ii) For any global phi type p(x) and any model M , if p is finitely satisfiable in M , then p is generalized DBSC definable over M . In particular, if M is countable, p is DBSC definable over M . (Cf. Definition 3.3, Fact 3.4.) (iii) For any global Keisler phi measure mu(x) and any model M , if mu is finitely satisfiable in M , then mu is generalized Baire 1 2 definable over M . In particular, if M is countable, p is Baire 1 2 definable over M . (Cf. Definition 3.5.) (iv) For any model M and any Keisler phi measure mu(x) over M , begin align sup b in M frac 1 k sum 1 k phi(p i,b) mu( phi(x,b)) to 0 end align for almost every (p i) in S phi (M) Bbb N with the product measure mu Bbb N . (Cf. Theorem 4.3.) (v) Suppose moreover that T is countable, then for any countable model M , the space of global M finitely satisfied types measures is a Rosenthal compactum. (Cf. Theorem A.1.)


TC DTW Accelerating Multivariate Dynamic Time Warping Through Triangle Inequality and Point Clustering. Dynamic time warping (DTW) plays an important role in analytics on time series. Despite the large body of research on speeding up univariate DTW, the method for multivariate DTW has not been improved much in the last two decades. The most popular algorithm used today is still the one developed seventeen years ago. This paper presents a solution that, as far as we know, for the first time consistently outperforms the classic multivariate DTW algorithm across dataset sizes, series lengths, data dimensions, temporal window sizes, and machines. The new solution, named TC DTW, introduces Triangle Inequality and Point Clustering into the algorithm design on lower bound calculations for multivariate DTW. In experiments on DTW based nearest neighbor finding, the new solution avoids as much as 98 (60 average) DTW distance calculations and yields as much as 25X (7.5X average) speedups.


Faster Meta Update Strategy for Noise Robust Deep Learning. It has been shown that deep neural networks are prone to overfitting on biased training data. Towards addressing this issue, meta learning employs a meta model for correcting the training bias. Despite the promising performances, super slow training is currently the bottleneck in the meta learning approaches. In this paper, we introduce a novel Faster Meta Update Strategy (FaMUS) to replace the most expensive step in the meta gradient computation with a faster layer wise approximation. We empirically find that FaMUS yields not only a reasonably accurate but also a low variance approximation of the meta gradient. We conduct extensive experiments to verify the proposed method on two tasks. We show our method is able to save two thirds of the training time while still maintaining the comparable or achieving even better generalization performance. In particular, our method achieves the state of the art performance on both synthetic and realistic noisy labels, and obtains promising performance on long tailed recognition on standard benchmarks.


Multiple instance active learning for object detection. Despite the substantial progress of active learning for image recognition, there still lacks an instance level active learning method specified for object detection. In this paper, we propose Multiple Instance Active Object Detection (MI AOD), to select the most informative images for detector training by observing instance level uncertainty. MI AOD defines an instance uncertainty learning module, which leverages the discrepancy of two adversarial instance classifiers trained on the labeled set to predict instance uncertainty of the unlabeled set. MI AOD treats unlabeled images as instance bags and feature anchors in images as instances, and estimates the image uncertainty by re weighting instances in a multiple instance learning (MIL) fashion. Iterative instance uncertainty learning and re weighting facilitate suppressing noisy instances, toward bridging the gap between instance uncertainty and image level uncertainty. Experiments validate that MI AOD sets a solid baseline for instance level active learning. On commonly used object detection datasets, MI AOD outperforms state of the art methods with significant margins, particularly when the labeled sets are small. Code is available at https github.com yuantn MI AOD.


Plethystic exponential calculus and characteristic polynomials of permutations. We prove a family of identities, expressing generating functions of powers of characteristic polynomials of permutations, as finite or infinite products. These generalize formulae first obtained in a study of the geometry topology of symmetric products of real algebraic tori. The proof uses formal power series expansions of plethystic exponentials, and has been motivated by some recent applications of these combinatorial tools in supersymmetric gauge and string theories. Since the methods are elementary, we tried to be self contained, and relate to other topics such as the q binoomial theorem, and the cycle index and Molien series for the symmetric group.


Quasi inner automorphisms of Drinfeld modular groups. Let A be the set of elements in an algebraic function field K over mathbb F q which are integral outside a fixed place infty . Let G GL 2(A) be a it Drinfeld modular group . The normalizer of G in GL 2(K) , where K is the quotient field of A , gives rise to automorphisms of G , which we refer to as it quasi inner . Modulo the inner automorphisms of G they form a group Quinn(G) which is isomorphic to mathrm Cl (A) 2 , the 2 torsion in the ideal class group mathrm Cl (A) . The group Quinn(G) acts on all kinds of objects associated with G . For example, it acts freely on the cusps and elliptic points of G . If mathcal T is the associated Bruhat Tits tree the elements of Quinn(G) induce non trivial automorphisms of the quotient graph G setminus mathcal T , generalizing an earlier result of Serre. It is known that the ends of G setminus mathcal T are in one one correspondence with the cusps of G . Consequently Quinn(G) acts freely on the ends. In addition Quinn(G) acts transitively on those ends which are in one one correspondence with the vertices of G setminus mathcal T whose stabilizers are isomorphic to GL 2( mathbb F q) .


Synchronized Audio Visual Frames with Fractional Positional Encoding for Transformers in Video to Text Translation. Video to Text (VTT) is the task of automatically generating descriptions for short audio visual video clips, which can support visually impaired people to understand scenes of a YouTube video for instance. Transformer architectures have shown great performance in both machine translation and image captioning, lacking a straightforward and reproducible application for VTT. However, there is no comprehensive study on different strategies and advice for video description generation including exploiting the accompanying audio with fully self attentive networks. Thus, we explore promising approaches from image captioning and video processing and apply them to VTT by developing a straightforward Transformer architecture. Additionally, we present a novel way of synchronizing audio and video features in Transformers which we call Fractional Positional Encoding (FPE). We run multiple experiments on the VATEX dataset to determine a configuration applicable to unseen datasets that helps describe short video clips in natural language and improved the CIDEr and BLEU 4 scores by 37.13 and 12.83 points compared to a vanilla Transformer network and achieve state of the art results on the MSR VTT and MSVD datasets. Also, FPE helps increase the CIDEr score by a relative factor of 8.6 .


Child Drawing Development Optimization Algorithm based on Child's Cognitive Development. This paper proposes a novel metaheuristic Child Drawing Development Optimization (CDDO) algorithm inspired by the child's learning behaviour and cognitive development using the golden ratio to optimize the beauty behind their art. The golden ratio was first introduced by the famous mathematician Fibonacci. The ratio of two consecutive numbers in the Fibonacci sequence is similar, and it is called the golden ratio, which is prevalent in nature, art, architecture, and design. CDDO uses golden ratio and mimics cognitive learning and child's drawing development stages starting from the scribbling stage to the advanced pattern based stage. Hand pressure width, length and golden ratio of the child's drawing are tuned to attain better results. This helps children with evolving, improving their intelligence and collectively achieving shared goals. CDDO shows superior performance in finding the global optimum solution for the optimization problems tested by 19 benchmark functions. Its results are evaluated against more than one state of art algorithms such as PSO, DE, WOA, GSA, and FEP. The performance of the CDDO is assessed, and the test result shows that CDDO is relatively competitive through scoring 2.8 ranks. This displays that the CDDO is outstandingly robust in exploring a new solution. Also, it reveals the competency of the algorithm to evade local minima as it covers promising regions extensively within the design space and exploits the best solution.


Hamiltonian cycles in 4 connected planar and projective planar triangulations with few 4 separators. Whitney proved in 1931 that every 4 connected planar triangulation is hamiltonian. Later in 1979, Hakimi, Schmeichel and Thomassen conjectured that every such triangulation on n vertices has at least 2(n 2)(n 4) hamiltonian cycles. Along this direction, Brinkmann, Souffriau and Van Cleemput established a linear lower bound on the number of hamiltonian cycles in 4 connected planar triangulations. In stark contrast, Alahmadi, Aldred and Thomassen showed that every 5 connected triangulation of the plane or the projective plane has exponentially many hamiltonian cycles. This gives the motivation to study the number of hamiltonian cycles of 4 connected triangulations with few 4 separators. Recently, Liu and Yu showed that every 4 connected planar triangulation with O(n log n) 4 separators has a quadratic number of hamiltonian cycles. By adapting the framework of Alahmadi et al. we strengthen the last two aforementioned results. We prove that every 4 connected planar or projective planar triangulation with O(n) 4 separators has exponentially many hamiltonian cycles.


A Greedy Chip firing Game. We introduce a deterministic analogue of Markov chains that we call the hunger game. Like rotor routing, the hunger game deterministically mimics the behavior of both recurrent Markov chains and absorbing Markov chains. In the case of recurrent Markov chains with finitely many states, hunger game simulation concentrates around the stationary distribution with discrepancy falling off like N 1 , where N is the number of simulation steps in the case of absorbing Markov chains with finitely many states, hunger game simulation also exhibits concentration for hitting measures and expected hitting times with discrepancy falling off like N 1 rather than N 1 2 . When transition probabilities in a finite Markov chain are rational, the game is eventually periodic the period seems to be the same for all initial configurations and the basin of attraction appears to tile the configuration space (the set of hunger vectors) by translation, but we have not proved this.


Few shot learning via tensor hallucination. Few shot classification addresses the challenge of classifying examples given only limited labeled data. A powerful approach is to go beyond data augmentation, towards data synthesis. However, most of data augmentation synthesis methods for few shot classification are overly complex and sophisticated, e.g. training a wGAN with multiple regularizers or training a network to transfer latent diversities from known to novel classes. We make two contributions, namely we show that (1) using a simple loss function is more than enough for training a feature generator in the few shot setting and (2) learning to generate tensor features instead of vector features is superior. Extensive experiments on miniImagenet, CUB and CIFAR FS datasets show that our method sets a new state of the art, outperforming more sophisticated few shot data augmentation methods.


Assessing the Acceptability of a Humanoid Robot for Alzheimer's Disease and Related Dementia Care Using an Online Survey. In this work, an online survey was used to understand the acceptability of humanoid robots and users' needs in using these robots to assist with care among people with Alzheimer's disease and related dementias (ADRD), their family caregivers, health care professionals, and the general public. From November 12, 2020 to March 13, 2021, a total of 631 complete responses were collected, including 80 responses from people with mild cognitive impairment or ADRD, 245 responses from caregivers and health care professionals, and 306 responses from the general public. Overall, people with ADRD, caregivers, and the general public showed positive attitudes towards using the robot to assist with care for people with ADRD. The top three functions of robots required by the group of people with ADRD were reminders to take medicine, emergency call service, and helping contact medical services. Additional comments, suggestions, and concerns provided by caregivers and the general public are also discussed.


Explaining Time Series Predictions with Dynamic Masks. How can we explain the predictions of a machine learning model? When the data is structured as a multivariate time series, this question induces additional difficulties such as the necessity for the explanation to embody the time dependency and the large number of inputs. To address these challenges, we propose dynamic masks (Dynamask). This method produces instance wise importance scores for each feature at each time step by fitting a perturbation mask to the input sequence. In order to incorporate the time dependency of the data, Dynamask studies the effects of dynamic perturbation operators. In order to tackle the large number of inputs, we propose a scheme to make the feature selection parsimonious (to select no more feature than necessary) and legible (a notion that we detail by making a parallel with information theory). With synthetic and real world data, we demonstrate that the dynamic underpinning of Dynamask, together with its parsimony, offer a neat improvement in the identification of feature importance over time. The modularity of Dynamask makes it ideal as a plug in to increase the transparency of a wide range of machine learning models in areas such as medicine and finance, where time series are abundant.


Reccurence Sets for Partial Inverse, Semigroup Actions and Related Structures. Two types of recurrence sets are introduced for inverse semigroup partial actions in topological spaces. We explore their connections with similar notions for related types of imperfect symmetries (prefix inverse semigroup expansions, partial group and groupoid actions).


Inclusions of C algebras of graded groupoids. We consider a locally compact Hausdorff groupoid G which is graded over a discrete group. Then the fibre over the identity is an open and closed subgroupoid G e . We show that both the full and reduced C algebras of this subgroupoid embed isometrically into the full and reduced C algebras of G this extends a theorem of Kaliszewski Quigg Raeburn from the 'etale to the non 'etale setting. As an application we show that the full and reduced C algebras of G are topologically graded in the sense of Exel, and we discuss the full and reduced C algebras of the associated bundles.


Data Free Knowledge Distillation for Heterogeneous Federated Learning. Federated Learning (FL) is a decentralized machine learning paradigm, in which a global server iteratively averages the model parameters of local users without accessing their data. User heterogeneity has imposed significant challenges to FL, which can incur drifted global models that are slow to converge. Knowledge Distillation has recently emerged to tackle this issue, by refining the server model using aggregated knowledge from heterogeneous users, other than directly averaging their model parameters. This approach, however, depends on a proxy dataset, making it impractical unless such a prerequisite is satisfied. Moreover, the ensemble knowledge is not fully utilized to guide local model learning, which may in turn affect the quality of the aggregated model. Inspired by the prior art, we propose a data free knowledge distillation approach to address heterogeneous FL, where the server learns a lightweight generator to ensemble user information in a data free manner, which is then broadcasted to users, regulating local training using the learned knowledge as an inductive bias. Empirical studies powered by theoretical implications show that, our approach facilitates FL with better generalization performance using fewer communication rounds, compared with the state of the art.


On a matrix element representation of special functions associated with toric varieties. We develop representation theory approach to the study of special functions associated with toric varieties. In particular we show that the corresponding special functions are given by matrix elements of certain non reductive Lie algebras


Data Augmentation for Object Detection via Differentiable Neural Rendering. It is challenging to train a robust object detector under the supervised learning setting when the annotated data are scarce. Thus, previous approaches tackling this problem are in two categories semi supervised learning models that interpolate labeled data from unlabeled data, and self supervised learning approaches that exploit signals within unlabeled data via pretext tasks. To seamlessly integrate and enhance existing supervised object detection methods, in this work, we focus on addressing the data scarcity problem from a fundamental viewpoint without changing the supervised learning paradigm. We propose a new offline data augmentation method for object detection, which semantically interpolates the training data with novel views. Specifically, our new system generates controllable views of training images based on differentiable neural rendering, together with corresponding bounding box annotations which involve no human intervention. Firstly, we extract and project pixel aligned image features into point clouds while estimating depth maps. We then re project them with a target camera pose and render a novel view 2d image. Objects in the form of keypoints are marked in point clouds to recover annotations in new views. Our new method is fully compatible with online data augmentation methods, such as affine transform, image mixup, etc. Extensive experiments show that our method, as a cost free tool to enrich images and labels, can significantly boost the performance of object detection systems with scarce training data. Code is available at url https github.com Guanghan DANR .


A Logic for Reasoning About LF Specifications. We present a logic named L LF whose intended use is to formalize properties of specifications developed in the dependently typed lambda calculus LF. The logic is parameterized by the LF signature that constitutes the specification. Atomic formulas correspond to typing derivations relative to this signature. The logic includes a collection of propositional connectives and quantifiers. Quantification ranges over expressions that denote LF terms and LF contexts. Quantifiers of the first variety are qualified by simple types that describe the functional structure associated with the variables they bind deeper, dependency related properties are expressed by the body of the formula. Context level quantifiers are qualified by context schemas that identify patterns of declarations out of which actual contexts may be constructed. The semantics of variable free atomic formulas is articulated via the derivability in LF of the judgements they encode. Propositional constants and connectives are understood in the usual manner and the meaning of quantifiers is explicated through substitutions of expressions that adhere to the type qualifications. The logic is complemented by a proof system that enables reasoning that is sound with respect to the described semantics. The main novelties of the proof system are the provision for case analysis style reasoning about LF judgements, support for inductive reasoning over the heights of LF derivations and the encoding of LF meta theorems. The logic is motivated by the paradigmatic example of type assignment in the simply typed lambda calculus and the proof system is illustrated through the formalization of a proof of type uniqueness for this calculus.


Improving Pretrained Cross Lingual Language Models via Self Labeled Word Alignment. The cross lingual language models are typically pretrained with masked language modeling on multilingual text or parallel sentences. In this paper, we introduce denoising word alignment as a new cross lingual pre training task. Specifically, the model first self labels word alignments for parallel sentences. Then we randomly mask tokens in a bitext pair. Given a masked token, the model uses a pointer network to predict the aligned token in the other language. We alternately perform the above two steps in an expectation maximization manner. Experimental results show that our method improves cross lingual transferability on various datasets, especially on the token level tasks, such as question answering, and structured prediction. Moreover, the model can serve as a pretrained word aligner, which achieves reasonably low error rates on the alignment benchmarks. The code and pretrained parameters are available at https github.com CZWin32768 XLM Align.


Personalizing Performance Regression Models to Black Box Optimization Problems. Accurately predicting the performance of different optimization algorithms for previously unseen problem instances is crucial for high performing algorithm selection and configuration techniques. In the context of numerical optimization, supervised regression approaches built on top of exploratory landscape analysis are becoming very popular. From the point of view of Machine Learning (ML), however, the approaches are often rather naive, using default regression or classification techniques without proper investigation of the suitability of the ML tools. With this work, we bring to the attention of our community the possibility to personalize regression models to specific types of optimization problems. Instead of aiming for a single model that works well across a whole set of possibly diverse problems, our personalized regression approach acknowledges that different models may suite different types of problems. Going one step further, we also investigate the impact of selecting not a single regression model per problem, but personalized ensembles. We test our approach on predicting the performance of numerical optimization heuristics on the BBOB benchmark collection.


On Completeness of Cost Metrics and Meta Search Algorithms in Calculus. In the paper we define three new complexity classes for Turing Machine undecidable problems inspired by the famous Cook Levin's NP complete complexity class for intractable problems. These are U complete (Universal complete), D complete (Diagonalization complete) and H complete (Hypercomputation complete) classes. We started the population process of these new classes. We justify that some super Turing models of computation, i.e., models going beyond Turing machines, are tremendously expressive and they allow to accept arbitrary languages over a given alphabet including those undecidable ones. We prove also that one of such super Turing models of computation the Calculus, designed as a tool for automatic problem solving and automatic programming, has also such tremendous expressiveness. We investigate also completeness of cost metrics and meta search algorithms in calculus.


Polarization dependent mode coupling in hyperbolic nanospheres. Hyperbolic materials offer a much wider freedom in designing optical properties of nanostructures than ones with isotropic and elliptical dispersion, both metallic or dielectric. Here, we present a detailed theoretical and numerical study of the unique optical properties of spherical nanoantennas composed of such materials. Hyperbolic nanospheres exhibit a rich modal structure that, depending on the polarization and direction of incident light, can exhibit either a full plasmonic like response with multiple electric resonances, a single, dominant electric dipole or one with mixed magnetic and electric modes with an atypical reversed modal order. We derive resonance conditions for observing these resonances in the dipolar approximation and offer insight into how the modal response evolves with the size, material composition, and illumination. Specifically, the origin of the magnetic dipole mode lies in the hyperbolic dispersion and its existence is determined by two diagonal permittivity components of different sign. Our analysis shows that the origin of this unusual behavior stems from complex coupling between electric and magnetic multipoles, which leads to very strongly scattering or absorbing modes. These observations assert that hyperbolic nanoantennas offer a promising route towards novel light matter interaction regimes.


Equivariant and Invariant Reynolds Networks. Invariant and equivariant networks are useful in learning data with symmetry, including images, sets, point clouds, and graphs. In this paper, we consider invariant and equivariant networks for symmetries of finite groups. Invariant and equivariant networks have been constructed by various researchers using Reynolds operators. However, Reynolds operators are computationally expensive when the order of the group is large because they use the sum over the whole group, which poses an implementation difficulty. To overcome this difficulty, we consider representing the Reynolds operator as a sum over a subset instead of a sum over the whole group. We call such a subset a Reynolds design, and an operator defined by a sum over a Reynolds design a reductive Reynolds operator. For example, in the case of a graph with n nodes, the computational complexity of the reductive Reynolds operator is reduced to O(n 2) , while the computational complexity of the Reynolds operator is O(n!) . We construct learning models based on the reductive Reynolds operator called equivariant and invariant Reynolds networks (ReyNets) and prove that they have universal approximation property. Reynolds designs for equivariant ReyNets are derived from combinatorial observations with Young diagrams, while Reynolds designs for invariant ReyNets are derived from invariants called Reynolds dimensions defined on the set of invariant polynomials. Numerical experiments show that the performance of our models is comparable to state of the art methods.


Unsupervised Domain Adaptation for Semantic Image Segmentation a Comprehensive Survey. Semantic segmentation plays a fundamental role in a broad variety of computer vision applications, providing key information for the global understanding of an image. Yet, the state of the art models rely on large amount of annotated samples, which are more expensive to obtain than in tasks such as image classification. Since unlabelled data is instead significantly cheaper to obtain, it is not surprising that Unsupervised Domain Adaptation reached a broad success within the semantic segmentation community. This survey is an effort to summarize five years of this incredibly rapidly growing field, which embraces the importance of semantic segmentation itself and a critical need of adapting segmentation models to new environments. We present the most important semantic segmentation methods we provide a comprehensive survey on domain adaptation techniques for semantic segmentation we unveil newer trends such as multi domain learning, domain generalization, test time adaptation or source free domain adaptation we conclude this survey by describing datasets and benchmarks most widely used in semantic segmentation research. We hope that this survey will provide researchers across academia and industry with a comprehensive reference guide and will help them in fostering new research directions in the field.


Threat Actor Type Inference and Characterization within Cyber Threat Intelligence. As the cyber threat landscape is constantly becoming increasingly complex and polymorphic, the more critical it becomes to understand the enemy and its modus operandi for anticipatory threat reduction. Even though the cyber security community has developed a certain maturity in describing and sharing technical indicators for informing defense components, we still struggle with non uniform, unstructured, and ambiguous higher level information, such as the threat actor context, thereby limiting our ability to correlate with different sources to derive more contextual, accurate, and relevant intelligence. We see the need to overcome this limitation in order to increase our ability to produce and better operationalize cyber threat intelligence. Our research demonstrates how commonly agreed upon controlled vocabularies for characterizing threat actors and their operations can be used to enrich cyber threat intelligence and infer new information at a higher contextual level that is explicable and queryable. In particular, we present an ontological approach to automatically inferring the types of threat actors based on their personas, understanding their nature, and capturing polymorphism and changes in their behavior and characteristics over time. Such an approach not only enables interoperability by providing a structured way and means for sharing highly contextual cyber threat intelligence but also derives new information at machine speed and minimizes cognitive biases that manual classification approaches entail.


Validation of the smooth step model by particle in cell Monte Carlo collisions simulations. Bounded plasmas are characterized by a rapid but smooth transition from quasi neutrality in the volume to electron depletion close to the electrodes and chamber walls. The thin non neutral region, the boundary sheath, comprises only a small fraction of the discharge domain but controls much of its macroscopic behavior. Insights into the properties of the sheath and its relation to the plasma are of high practical and theoretical interest. The recently proposed smooth step model provides a closed analytical expression for the electric field in a planar, radio frequency modulated sheath. It represents (i) the space charge field in the depletion zone, (ii) the generalized Ohmic and ambipolar field in the quasi neutral zone, and (iii) a smooth interpolation for the transition in between. This investigation compares the smooth step model with the predictions of a more fundamental particle in cell Monte Carlo collisions simulation and finds good quantitative agreement when the assumed length and time scale requirements are met. A second simulation case illustrates that the model remains applicable even when the assumptions are only marginally fulfilled


An algorithm to find ribbon disks for alternating knots. We describe an algorithm to find ribbon disks for alternating knots, and the results of a computer implementation of this algorithm. The algorithm is underlain by a slice link obstruction coming from Donaldson's diagonalisation theorem. It successfully finds ribbon disks for slice two bridge knots and for the connected sum of any alternating knot with its reverse mirror, as well as for 81,560 prime alternating knots of 19 or fewer crossings. We also identify some examples of ribbon alternating knots for which the algorithm fails to find ribbon disks.


DUKweb Diachronic word representations from the UK Web Archive corpus. Lexical semantic change (detecting shifts in the meaning and usage of words) is an important task for social and cultural studies as well as for Natural Language Processing applications. Diachronic word embeddings (time sensitive vector representations of words that preserve their meaning) have become the standard resource for this task. However, given the significant computational resources needed for their generation, very few resources exist that make diachronic word embeddings available to the scientific community. In this paper we present DUKweb, a set of large scale resources designed for the diachronic analysis of contemporary English. DUKweb was created from the JISC UK Web Domain Dataset (1996 2013), a very large archive which collects resources from the Internet Archive that were hosted on domains ending in .uk'. DUKweb consists of a series word co occurrence matrices and two types of word embeddings for each year in the JISC UK Web Domain dataset. We show the reuse potential of DUKweb and its quality standards via a case study on word meaning change detection.


Numerical Differentiation using local Chebyshev Approximation. In applied mathematics, especially in optimization, functions are often only provided as so called "Black Boxes" provided by software packages, or very complex algorithms, which make automatic differentation very complicated or even impossible. Hence one seeks the numerical approximation of the derivative. Unfortunately numerical differentation is a difficult task in itself, and it is well known that it is numerical instable. There are many works on this topic, including the usage of (global) Chebyshev approximations. Chebyshev approximations have the great property that they converge very fast, if the function is smooth. Nevertheless those approches have several drawbacks, since in practice functions are not smooth, and a global approximation needs many function evalutions. Nevertheless there is hope. Since functions in real world applications are most times smooth except for finite points, corners or edges. This motivates to use a local Chebyshev approach, where the function is only approximated locally, and hence the Chebyshev approximations still yields a fast approximation of the desired function. We will study such an approch in this work, and will provide a numerical example


Meta optimization for Fully Automated Radiation Therapy Treatment Planning. Objective Radiation therapy treatment planning is a time consuming process involving iterative adjustments of hyperparameters. To automate the treatment planning process, we propose a meta optimization framework, called MetaPlanner (MP). Methods Our MP algorithm automates planning by performing optimization of treatment planning hyperparameters. The algorithm uses a derivative free method (i.e. parallel Nelder Mead simplex search) to search for weight configurations that minimize a meta scoring function. Meta scoring is performed by constructing a tier list of the relevant considerations (e.g. dose homogeneity, conformity, spillage, and OAR sparing) to mimic the clinical decision making process. Additionally, we have made our source code publicly available via github. Results The proposed MP method is evaluated on two datasets (21 prostate cases and 6 head and neck cases) collected as part of clinical workflow. MP is applied to both IMRT and VMAT planning and compared to a baseline of manual VMAT plans. MP in both IMRT and VMAT scenarios has comparable or better performance than manual VMAT planning for all evaluated metrics. Conclusion Our proposed MP provides a general framework for fully automated treatment planning that produces high quality treatment plans. Significance Our MP method promises to substantially reduce the workload of treatment planners while maintaining or improving plan quality.


A bijection between the indecomposable summands of two multiplicity free tilting modules. We show that there is a reflection type bijection between the indecomposable summands of two multiplicity free tilting modules X and Y . This bijection fixes the common indecomposable summands of X and Y and sends indecomposable projective (resp., injective) summands of exactly one module to non projective (resp., non injective) summands of the other. Moreover, this bijection interchanges the two possible non isomorphic complements of an almost complete tilting module.


The Curious Case of the Diamond Network. This work considers the one shot capacity of communication networks subject to adversarial noise affecting a subset of network edges. In particular, we examine previously established upper bounds on one shot capacity. We introduce the Diamond Network as a minimal example to show that known cut set bounds are not sharp in general. We then give a capacity achieving scheme for the Diamond Network that implements an adversary detection strategy. Finally, we give a sufficient condition for tightness of the Singleton Cut Set Bound in a family of two level networks.


Multi Agent Constrained Policy Optimisation. Developing reinforcement learning algorithms that satisfy safety constraints is becoming increasingly important in real world applications. In multi agent reinforcement learning (MARL) settings, policy optimisation with safety awareness is particularly challenging because each individual agent has to not only meet its own safety constraints, but also consider those of others so that their joint behaviour can be guaranteed safe. Despite its importance, the problem of safe multi agent learning has not been rigorously studied very few solutions have been proposed, nor a sharable testing environment or benchmarks. To fill these gaps, in this work, we formulate the safe MARL problem as a constrained Markov game and solve it with policy optimisation methods. Our solutions Multi Agent Constrained Policy Optimisation (MACPO) and MAPPO Lagrangian leverage the theories from both constrained policy optimisation and multi agent trust region learning. Crucially, our methods enjoy theoretical guarantees of both monotonic improvement in reward and satisfaction of safety constraints at every iteration. To examine the effectiveness of our methods, we develop the benchmark suite of Safe Multi Agent MuJoCo that involves a variety of MARL baselines. Experimental results justify that MACPO MAPPO Lagrangian can consistently satisfy safety constraints, meanwhile achieving comparable performance to strong baselines.


Can Single Shuffle SGD be Better than Reshuffling SGD and GD?. We propose matrix norm inequalities that extend the Recht R 'e (2012) conjecture on a noncommutative AM GM inequality by supplementing it with another inequality that accounts for single shuffle, which is a widely used without replacement sampling scheme that shuffles only once in the beginning and is overlooked in the Recht R 'e conjecture. Instead of general positive semidefinite matrices, we restrict our attention to positive definite matrices with small enough condition numbers, which are more relevant to matrices that arise in the analysis of SGD. For such matrices, we conjecture that the means of matrix products corresponding to with and without replacement variants of SGD satisfy a series of spectral norm inequalities that can be summarized as "single shuffle SGD converges faster than random reshuffle SGD, which is in turn faster than with replacement SGD." We present theorems that support our conjecture by proving several special cases.


Algebraic properties of the group inverse. We investigate properties of the group inverse in rings with unit related to products and differences of idempotents, and thus we extend some results from cite DENG to more general settings. We show that most part of cite DENG is easily translated into the context of rings with unit, and that there are some difficulties in generalizing statements dealing with complementary idempotents.


Anomaly Detection via Self organizing Map. Anomaly detection plays a key role in industrial manufacturing for product quality control. Traditional methods for anomaly detection are rule based with limited generalization ability. Recent methods based on supervised deep learning are more powerful but require large scale annotated datasets for training. In practice, abnormal products are rare thus it is very difficult to train a deep model in a fully supervised way. In this paper, we propose a novel unsupervised anomaly detection approach based on Self organizing Map (SOM). Our method, Self organizing Map for Anomaly Detection (SOMAD) maintains normal characteristics by using topological memory based on multi scale features. SOMAD achieves state of the art performance on unsupervised anomaly detection and localization on the MVTec dataset.


An Efficient High order Numerical Solver for Diffusion Equations with Strong Anisotropy. In this paper, we present an interior penalty discontinuous Galerkin finite element scheme for solving diffusion problems with strong anisotropy arising in magnetized plasmas for fusion applications. We demonstrate the accuracy produced by the high order scheme and develop an efficient preconditioning technique to solve the corresponding linear system, which is robust to the mesh size and anisotropy of the problem. Several numerical tests are provided to validate the accuracy and efficiency of the proposed algorithm.


A priori and a posteriori error analysis of the lowest order NCVEM for second order linear indefinite elliptic problems. The nonconforming virtual element method (NCVEM) for the approximation of the weak solution to a general linear second order non selfadjoint indefinite elliptic PDE in a polygonal domain is analyzed under reduced elliptic regularity. The main tool in the a priori error analysis is the connection between the nonconforming virtual element space and the Sobolev space H 1 0( Omega) by a right inverse J of the interpolation operator I h . The stability of the discrete solution allows for the proof of existence of a unique discrete solution, of a discrete inf sup estimate and, consequently, for optimal error estimates in the H 1 and L 2 norms. The explicit residual based a posteriori error estimate for the NCVEM is reliable and efficient up to the stabilization and oscillation terms. Numerical experiments on different types of polygonal meshes illustrate the robustness of an error estimator and support the improved convergence rate of an adaptive mesh refinement in comparison to the uniform mesh refinement.


Application of the notion of varphi object to the study of p class groups and p ramified torsion groups of abelian extensions. We revisit, in an elementary way, the statement of the "Main Conjecture" for p class groups and p ramified torsion groups in abelian fields K in the non semi simple case p divides K Q for this, we have used an "arithmetic" definition of p adic isotopic components, different from the "algebraic" one used in the literature but inappropriate with respect to analytical formulas. The two notions coincide for relative class groups and real torsion groups of p ramification theory, but not for real class groups. Numerical evidence of the gap between the two notions is given (Examples 3.12, 3.13). It would remain to make use of classical tools for this non semi simple real context, still unproved as explained Section 1.4. In S7.6, we shed new light on the classical proof of the Main Conjecture in the real semi simple case. Two conjectures are proposed. PARI GP programs of the tables are given.


BVMatch Lidar based Place Recognition Using Bird's eye View Images. Recognizing places using Lidar in large scale environments is challenging due to the sparse nature of point cloud data. In this paper we present BVMatch, a Lidar based frame to frame place recognition framework, that is capable of estimating 2D relative poses. Based on the assumption that the ground area can be approximated as a plane, we uniformly discretize the ground area into grids and project 3D Lidar scans to bird's eye view (BV) images. We further use a bank of Log Gabor filters to build a maximum index map (MIM) that encodes the orientation information of the structures in the images. We analyze the orientation characteristics of MIM theoretically and introduce a novel descriptor called bird's eye view feature transform (BVFT). The proposed BVFT is insensitive to rotation and intensity variations of BV images. Leveraging the BVFT descriptors, we unify the Lidar place recognition and pose estimation tasks into the BVMatch framework. The experiments conducted on three large scale datasets show that BVMatch outperforms the state of the art methods in terms of both recall rate of place recognition and pose estimation accuracy. The source code of our method is publicly available at https github.com zjuluolun BVMatch.


Dynamic Modeling of Hand Object Interactions via Tactile Sensing. Tactile sensing is critical for humans to perform everyday tasks. While significant progress has been made in analyzing object grasping from vision, it remains unclear how we can utilize tactile sensing to reason about and model the dynamics of hand object interactions. In this work, we employ a high resolution tactile glove to perform four different interactive activities on a diversified set of objects. We build our model on a cross modal learning framework and generate the labels using a visual processing pipeline to supervise the tactile model, which can then be used on its own during the test time. The tactile model aims to predict the 3d locations of both the hand and the object purely from the touch data by combining a predictive model and a contrastive learning module. This framework can reason about the interaction patterns from the tactile data, hallucinate the changes in the environment, estimate the uncertainty of the prediction, and generalize to unseen objects. We also provide detailed ablation studies regarding different system designs as well as visualizations of the predicted trajectories. This work takes a step on dynamics modeling in hand object interactions from dense tactile sensing, which opens the door for future applications in activity learning, human computer interactions, and imitation learning for robotics.


Connecting wall modes and boundary zonal flows in rotating Rayleigh B 'enard convection. Using direct numerical simulations, we study rotating Rayleigh B 'enard convection in a cylindrical cell for a broad range of Rayleigh, Ekman, and Prandtl numbers from the onset of wall modes to the geostrophic regime, an extremely important one in geophysical and astrophysical contexts. We connect linear wall mode states that occur prior to the onset of bulk convection with the boundary zonal flow that coexists with turbulent bulk convection in the geostrophic regime through the continuity of length and time scales and of convective heat transport. We quantitatively collapse drift frequency, boundary length, and heat transport data from numerous sources over many orders of magnitude in Rayleigh and Ekman numbers. Elucidating the heat transport contributions of wall modes and of the boundary zonal flow are critical for characterizing the properties of the geostrophic regime of rotating convection in finite, physical containers and is crucial for connecting the geostrophic regime of laboratory convection with geophysical and astrophysical systems.


q Analogues of pi Related Formulae from Jackson's 8 phi 7 Series via Inversion Approach. By making use of the multiplicate form of the extended Carlitz inverse series relations, we establish two general dual' theorems of Jackson's summation formula for well poised 8 phi 7 series. Their duplicate forms under the partition pattern n lfloor frac n 2 rfloor lfloor frac n 1 2 rfloor are explored and yield numerous q series identities whose limiting cases as q to1 result in classical pi related Ramanujan like series of convergence rate frac1 16 " including one for 1 pi 2 discovered by Guillera (2003). The triplicate dual formulae under the partition pattern n lfloor frac n 3 rfloor lfloor frac n 1 3 rfloor lfloor frac n 2 3 rfloor are examined via the reverse bisection method", which leads us to twenty new q series identities together with their classical counterparts of convergence rate frac 1 27 " when q to1 .


Roaming pathways and survival probability in real time collisional dynamics of cold and controlled bialkali molecules. Perfectly controlled molecules are at the forefront of the quest to explore chemical reactivity at ultra low temperatures. Here, we investigate for the first time the formation of the long lived intermediates in the time dependent scattering of cold bialkali 23 Na 87 Rb molecules with and without the presence of infrared trapping light. During the nearly 50 nanoseconds mean collision time of the intermediate complex, we observe unconventional roaming when for a few tens of picoseconds either NaRb or Na 2 and Rb 2 molecules with large relative separation are formed before returning to the four atom complex. We also determine the likelihood of molecular loss when the trapping laser is present during the collision. We find that at a wavelength of 1064 nm the Na 2 Rb 2 complex is quickly destroyed and thus that the 23 Na 87 Rb molecules are rapidly lost.


Bidemocratic bases and their connections with other greedy type bases. In nonlinear greedy approximation theory, bidemocratic bases have traditionally played the role of dualizing democratic, greedy, quasi greedy, or almost greedy bases. In this article we shift the viewpoint and study them for their own sake, just as we would with any other kind of greedy type bases. In particular we show that bidemocratic bases need not be quasi greedy, despite the fact that they retain a strong unconditionality flavor which brings them very close to being quasi greedy. Our constructive approach gives that for each 1 p infty the space ell p has a bidemocratic basis which is not quasi greedy. We also present a novel method for constructing conditional quasi greedy bases which are bidemocratic, and provide a characterization of bidemocratic bases in terms of the new concepts of truncation quasi greediness and partially democratic bases.


Incremental Graph Computation Anchored Vertex Tracking in Dynamic Social Networks. User engagement has recently received significant attention in understanding the decay and expansion of communities in many online social networking platforms. Many user engagement studies have done to find a set of critical (anchored) users in the static social network. However, the social network is highly dynamic and its structure is continuously evolving. In this paper, we target a new research problem called Anchored Vertex Tracking (AVT) that aims to track the anchored users at each timestamp of evolving networks. To solve the AVT problem, we develop a greedy algorithm. Furthermore, we design an incremental algorithm to efficiently solve the AVT problem. Finally, we conduct extensive experiments to demonstrate the performance of our proposed algorithms.


Indoor Panorama Planar 3D Reconstruction via Divide and Conquer. Indoor panorama typically consists of human made structures parallel or perpendicular to gravity. We leverage this phenomenon to approximate the scene in a 360 degree image with (H)orizontal planes and (V)ertical planes. To this end, we propose an effective divide and conquer strategy that divides pixels based on their plane orientation estimation then, the succeeding instance segmentation module conquers the task of planes clustering more easily in each plane orientation group. Besides, parameters of V planes depend on camera yaw rotation, but translation invariant CNNs are less aware of the yaw change. We thus propose a yaw invariant V planar reparameterization for CNNs to learn. We create a benchmark for indoor panorama planar reconstruction by extending existing 360 depth datasets with ground truth H V planes (referred to as PanoH V dataset) and adopt state of the art planar reconstruction methods to predict H V planes as our baselines. Our method outperforms the baselines by a large margin on the proposed dataset.


Influence of Temporal Variations in Plasma Conditions on the Electric Potential Near Self Organized Dust Chains. The self organization of dust grains into stable filamentary dust structures (or "chains") largely depends on dynamic interactions between the individual charged dust grains and the complex electric potential arising from the distribution of charges within the local plasma environment. Recent studies have shown that the positive column of the gas discharge plasma in the Plasmakristall 4 (PK 4) experiment onboard the International Space Station (ISS) supports the presence of fast moving ionization waves, which lead to variations of plasma parameters by up to an order of magnitude from the average background values. The highly variable environment resulting from ionization waves may have interesting implications for the dynamics and self organization of dust particles, particularly concerning the formation and stability of dust chains. Here we investigate the electric potential surrounding dust chains in the PK 4 by employing a molecular dynamics model of the dust and ions with boundary conditions supplied by a Particle in Cell with Monte Carlo collisions (PIC MCC) simulation of the ionization waves. The model is used to examine the effects of the plasma conditions within different regions of the ionization wave and compare the resulting dust structure to that obtained by employing the time averaged plasma conditions. Comparison between simulated dust chains and experimental data from the PK 4 shows that the time averaged plasma conditions do not accurately reproduce observed results for dust behavior, indicating that more careful treatment of plasma conditions in the presence of ionization waves is required. It is further shown that commonly used analytic forms of the electric potential do not accurately describe the electric potential near charged dust grains under these plasma conditions.


Leafwise Quasigeodesic Foliation in Dimension Three and the Funnel Property. We construct one dimensional foliations which are subfoliations of two dimensional foliations in 3 manifolds. The subfoliation is by quasigeodesics in each two dimensional leaf, but it is not funnel not all quasigeodesics share a common ideal point in most leaves. This article answers the question whether the funnel property is a consequence of the leafwise quasigeodesic property or not.


Experimental observation of spontaneous temperature fluctuations in turbulent flows. Even in the absence of externally applied temperature gradients, spontaneously generated temperature fluctuations arise in turbulent flows. We experimentally study these fluctuations in a closed von Karman swirling flow of air at Mach number of order 10 3 , whose boundaries are maintained at a constant temperature. We observe intermittent peaks of low temperature correlated with pressure drops within the flow and show that they are caused by vorticity filaments. The measured ratio of temperature to pressure fluctuation agrees with the prediction based on adiabatic cooling within vortex cores. This experimental study shows that although the Mach number of the flow is small, there exist regions within the flow where compressible effects cannot be discarded in the equation for temperature and locally dominate the effect of viscous dissipation.


DHASP Differentiable Hearing Aid Speech Processing. Hearing aids are expected to improve speech intelligibility for listeners with hearing impairment. An appropriate amplification fitting tuned for the listener's hearing disability is critical for good performance. The developments of most prescriptive fittings are based on data collected in subjective listening experiments, which are usually expensive and time consuming. In this paper, we explore an alternative approach to finding the optimal fitting by introducing a hearing aid speech processing framework, in which the fitting is optimised in an automated way using an intelligibility objective function based on the HASPI physiological auditory model. The framework is fully differentiable, thus can employ the back propagation algorithm for efficient, data driven optimisation. Our initial objective experiments show promising results for noise free speech amplification, where the automatically optimised processors outperform one of the well recognised hearing aid prescriptions.


Sublinear Time Hypergraph Sparsification via Cut and Edge Sampling Queries. The problem of sparsifying a graph or a hypergraph while approximately preserving its cut structure has been extensively studied and has many applications. In a seminal work, Bencz 'ur and Karger (1996) showed that given any n vertex undirected weighted graph G and a parameter varepsilon in (0,1) , there is a near linear time algorithm that outputs a weighted subgraph G' of G of size tilde O (n varepsilon 2) such that the weight of every cut in G is preserved to within a (1 pm varepsilon) factor in G' . The graph G' is referred to as a em (1 pm varepsilon) approximate cut sparsifier of G . Subsequent recent work has obtained a similar result for the more general problem of hypergraph cut sparsifiers. However, all known sparsification algorithms require Omega(n m) time where n denotes the number of vertices and m denotes the number of hyperedges in the hypergraph. Since m can be exponentially large in n , a natural question is if it is possible to create a hypergraph cut sparsifier in time polynomial in n , em independent of the number of edges . We resolve this question in the affirmative, giving the first sublinear time algorithm for this problem, given appropriate query access to the hypergraph.


Mesa A Memory saving Training Framework for Transformers. There has been an explosion of interest in designing high performance Transformers. While Transformers have delivered significant performance improvements, training such networks is extremely memory intensive owing to storing all intermediate activations that are needed for gradient computation during backpropagation, especially for long sequences. To this end, we present Mesa, a memory saving training framework for Transformers. Specifically, Mesa uses exact activations during forward pass while storing a low precision version of activations to reduce memory consumption during training. The low precision activations are then dequantized during back propagation to compute gradients. Besides, to address the heterogeneous activation distributions in the multi head self attention layers, we propose a head wise activation quantization strategy, which quantizes activations based on the statistics of each head to minimize the approximation error. To further boost training efficiency, we learn quantization parameters by running estimates. More importantly, by re investing the saved memory in employing a larger batch size or scaling up model size, we may further improve the performance under constrained computational resources. Extensive experiments on ImageNet, CIFAR 100 and ADE20K demonstrate that Mesa can achieve flexible memory savings (up to 50 ) during training while achieving comparable or even better performance. Code is available at https github.com zip group Mesa.


Uniformization of surfaces with boundary and the application to the triple junction surfaces with negative Euler characteristic. The conformal structure on minimal surfaces plays a key role in studying the properties of minimal surfaces. Here we extend the results of uniformization of surfaces with boundary to get the (weak) uniformization results for triple junction surfaces.


Machine Learning with Knowledge Constraints for Process Optimization of Open Air Perovskite Solar Cell Manufacturing. Perovskite photovoltaics (PV) have achieved rapid development in the past decade in terms of power conversion efficiency of small area lab scale devices however, successful commercialization still requires further development of low cost, scalable, and high throughput manufacturing techniques. One of the critical challenges of developing a new fabrication technique is the high dimensional parameter space for optimization, but machine learning (ML) can readily be used to accelerate perovskite PV scaling. Herein, we present an ML guided framework of sequential learning for manufacturing process optimization. We apply our methodology to the Rapid Spray Plasma Processing (RSPP) technique for perovskite thin films in ambient conditions. With a limited experimental budget of screening 100 process conditions, we demonstrated an efficiency improvement to 18.5 as the best in our lab device fabricated by RSPP, and we also experimentally found 10 unique process conditions to produce the top performing devices of more than 17 efficiency, which is 5 times higher rate of success than the control experiments with pseudo random Latin hypercube sampling. Our model is enabled by three innovations (a) flexible knowledge transfer between experimental processes by incorporating data from prior experimental data as a probabilistic constraint (b) incorporation of both subjective human observations and ML insights when selecting next experiments (c) adaptive strategy of locating the region of interest using Bayesian optimization first, and then conducting local exploration for high efficiency devices. Furthermore, in virtual benchmarking, our framework achieves faster improvements with limited experimental budgets than traditional design of experiments methods (e.g., one variable at a time sampling).


Energetic solutions to rate independent large strain elasto plastic evolutions driven by discrete dislocation flow. This work rigorously implements a recent model, introduced in arXiv 2109.08749 , of large strain elasto plastic evolution in single crystals where the plastic flow is driven by the movement of discrete dislocation lines. The model is geometrically and elastically nonlinear, that is, the total deformation gradient splits multiplicatively into elastic and plastic parts, and the elastic energy density is polyconvex. There are two internal variables The system of all dislocations is modeled via 1 dimensional boundaryless integral currents, whereas the history of plastic flow is encoded in a plastic distortion matrix field. As our main result we construct an energetic solution in the case of a rate independent flow rule. Besides the classical stability and energy balance conditions, our notion of solution also accounts for the movement of dislocations and the resulting plastic flow. Because of the path dependence of plastic flow, a central role is played by so called "slip trajectories", that is, the surfaces traced out by moving dislocations, which we represent as integral 2 currents in space time. The proof of our main existence result further crucially rests on careful a priori estimates via a nonlinear Gronwall type lemma and a rescaling of time. In particular, we have to account for the fact that the plastic flow may cause the coercivity of the elastic energy functional to decay along the evolution, and hence the solution may blow up in finite time.


Conjugacy growth in the higher Heisenberg groups. We calculate asymptotic estimates for the conjugacy growth function of finitely generated class 2 nilpotent groups whose derived subgroup is infinite cyclic, including the so called higher Heisenberg groups. We prove that these asymptotics are stable when passing to commensurable groups, by understanding their twisted conjugacy growth. We also use these estimates to prove that, in certain cases, the conjugacy growth series cannot be a holonomic function.


Research on Portfolio Liquidation Strategy under Discrete Times. This paper presents an optimal strategy for portfolio liquidation under discrete time conditions. We assume that N risky assets held will be liquidated according to the same time interval and order quantity, and the basic price processes of assets are generated by an N dimensional independent standard Brownian motion. The permanent impact generated by an asset in the portfolio during the liquidation will affect all assets, and the temporary impact generated by one asset will only affect itself. On this basis, we establish a liquidation cost model based on the VaR measurement and obtain an optimal liquidation time under discrete time conditions. The optimal solution shows that the liquidation time is only related to the temporary impact rather than the permanent impact. In the simulation analysis, we give the relationship between volatility parameters, temporary price impact and the optimal liquidation strategy.


Improving the Question Answering Quality using Answer Candidate Filtering based on Natural Language Features. Software with natural language user interfaces has an ever increasing importance. However, the quality of the included Question Answering (QA) functionality is still not sufficient regarding the number of questions that are answered correctly. In our work, we address the research problem of how the QA quality of a given system can be improved just by evaluating the natural language input (i.e., the user's question) and output (i.e., the system's answer). Our main contribution is an approach capable of identifying wrong answers provided by a QA system. Hence, filtering incorrect answers from a list of answer candidates is leading to a highly improved QA quality. In particular, our approach has shown its potential while removing in many cases the majority of incorrect answers, which increases the QA quality significantly in comparison to the non filtered output of a system.


Microstrip Patch Antenna Simulation using Comsol Multiphysics. In this renovating era of technology, human life has considerably changed like transport has been transformed from bull cart to aircraft, land line phones to 4G 5G cellular phones, CRT based T. V to LED T. V etc. Human being has perceived the huge revolution especially in the field of communication. We report on the simulation study of Microstrip patch antenna using Comsol Multiphysics 5.4 software. Transmitter, feed point, receiver, modulation are the several parameters which are most important during the fabrication of antenna. In this paper we explain the geometry, radiation patterns in E plane and H plane, scattering parameters, resonant frequency, bandwidth of microstrip patch antenna. In research field lot of work is done on antenna by many of the scientists but there is a challenge about the compactness of antenna. Microstrip patch antenna is much compact than other antennas and these types of antennas are used in our mobile. It attains the greater number of frequency bands, improved gain, better impedance matching and improved bandwidth. In this paper, frequency response of Microstrip Patch Antenna shows single band behaviour at frequency 1.575 GHz which gives improvement in reflection coefficient and wider bandwidth.


The Balmer spectrum of certain Deligne Mumford stacks. We consider a Deligne Mumford stack X which is the quotient of an affine scheme operatorname Spec A by the action of a finite group G . If the ring A is regular, the Balmer spectrum of the tensor triangulated category of perfect complexes on X is homeomorphic to the space of homogeneous prime ideals in the group cohomology ring H (G,A) .


Interaction decomposition for Hilbert spaces. The decomposition into interaction subspaces is an important result for graphical models and plays a central role for results on the linearized marginal problem similarly the Chaos decomposition plays an important role in statistical physics at the thermodynamic limit and in probability theory in general. We unify and extend both constructions by defining and characterizing decomposable functors from a well founded poset to the category of Hilbert spaces, completing previous work on decomposable collections of vector subspaces and presheaves.


New Measures for Shaping Trajectories in Dynamic Optimization. We propose a new class of measures for shaping time dependent trajectories in dynamic optimization (DO). The proposed measures are analogous to risk measures used in stochastic optimization (SO) and are inspired by a recently proposed unifying abstraction for infinite dimensional optimization. Risk measures are summarizing statistics (e.g., average, variance, quantiles, worst case values) that are used to shape the probability density of random objectives and constraints. We show that this extensive collection of measures can be applied in DO for computing and manipulating interesting features of time dependent trajectories (e.g., excursion costs and quantiles). We also discuss how to implement these measures in the Julia modeling package InfiniteOpt.jl.


Mutation Sensitive Correlation Filter for Real Time UAV Tracking with Adaptive Hybrid Label. Unmanned aerial vehicle (UAV) based visual tracking has been confronted with numerous challenges, e.g., object motion and occlusion. These challenges generally introduce unexpected mutations of target appearance and result in tracking failure. However, prevalent discriminative correlation filter (DCF) based trackers are insensitive to target mutations due to a predefined label, which concentrates on merely the centre of the training region. Meanwhile, appearance mutations caused by occlusion or similar objects usually lead to the inevitable learning of wrong information. To cope with appearance mutations, this paper proposes a novel DCF based method to enhance the sensitivity and resistance to mutations with an adaptive hybrid label, i.e., MSCF. The ideal label is optimized jointly with the correlation filter and remains temporal consistency. Besides, a novel measurement of mutations called mutation threat factor (MTF) is applied to correct the label dynamically. Considerable experiments are conducted on widely used UAV benchmarks. The results indicate that the performance of MSCF tracker surpasses other 26 state of the art DCF based and deep based trackers. With a real time speed of 38 frames s, the proposed approach is sufficient for UAV tracking commissions.


Relationships between the generalized central series of Leibniz algebras. The purpose of this article is to show a close relationship between the generalized central series of Leibniz algebras. Some analogues of the classical group theoretical theorems of Schur and Baer for Leibniz algebras are proved.


The Kervaire Milnor invariant in the stable classification of spin 4 manifolds. We consider the role of the Kervaire Milnor invariant in the classification of closed, connected, spin 4 manifolds up to stabilisation by connected sums with copies of S 2 times S 2 . This stable classification is detected by a spin bordism group over the classifying space B pi of the fundamental group. Part of the computation of this bordism group via an Atiyah Hirzebruch spectral sequence is determined by a collection of codimension two Arf invariants. We show that these Arf invariants can be computed by the Kervaire Milnor invariant evaluated on certain elements of pi 2 . In particular this yields a new stable classification of spin 4 manifolds with 2 dimensional fundamental groups.


Tell Me How to Survey Literature Review Made Simple with Automatic Reading Path Generation. Recent years have witnessed the dramatic growth of paper volumes with plenty of new research papers published every day, especially in the area of computer science. How to glean papers worth reading from the massive literature to do a quick survey or keep up with the latest advancement about a specific research topic has become a challenging task. Existing academic search engines such as Google Scholar return relevant papers by individually calculating the relevance between each paper and query. However, such systems usually omit the prerequisite chains of a research topic and cannot form a meaningful reading path. In this paper, we introduce a new task named Reading Path Generation (RPG) which aims at automatically producing a path of papers to read for a given query. To serve as a research benchmark, we further propose SurveyBank, a dataset consisting of large quantities of survey papers in the field of computer science as well as their citation relationships. Each survey paper contains key phrases extracted from its title and multi level reading lists inferred from its references. Furthermore, we propose a graph optimization based approach for reading path generation which takes the relationship between papers into account. Extensive evaluations demonstrate that our approach outperforms other baselines. A Real time Reading Path Generation System (RePaGer) has been also implemented with our designed model. To the best of our knowledge, we are the first to target this important research problem. Our source code of RePaGer system and SurveyBank dataset can be found on here.


A system of disjoint representatives of line segments with given k directions. We prove that for all positive integers n and k , there exists an integer N N(n,k) satisfying the following. If U is a set of k direction vectors in the plane and mathcal J U is the set of all line segments in direction u for some u in U , then for every N families mathcal F 1, ldots, mathcal F N , each consisting of n mutually disjoint segments in mathcal J U , there is a set A 1, ldots, A n of n disjoint segments in bigcup 1 leq i leq N mathcal F i and distinct integers p 1, ldots, p n in 1, ldots, N satisfying that A j in mathcal F p j for all j in 1, ldots, n . We generalize this property for underlying lines on fixed k directions to k families of simple curves with certain conditions.


A Deep Embedded Refined Clustering Approach for Breast Cancer Distinction based on DNA Methylation. Epigenetic alterations have an important role in the development of several types of cancer. Epigenetic studies generate a large amount of data, which makes it essential to develop novel models capable of dealing with large scale data. In this work, we propose a deep embedded refined clustering method for breast cancer differentiation based on DNA methylation. In concrete, the deep learning system presented here uses the levels of CpG island methylation between 0 and 1. The proposed approach is composed of two main stages. The first stage consists in the dimensionality reduction of the methylation data based on an autoencoder. The second stage is a clustering algorithm based on the soft assignment of the latent space provided by the autoencoder. The whole method is optimized through a weighted loss function composed of two terms reconstruction and classification terms. To the best of the authors' knowledge, no previous studies have focused on the dimensionality reduction algorithms linked to classification trained end to end for DNA methylation analysis. The proposed method achieves an unsupervised clustering accuracy of 0.9927 and an error rate ( ) of 0.73 on 137 breast tissue samples. After a second test of the deep learning based method using a different methylation database, an accuracy of 0.9343 and an error rate ( ) of 6.57 on 45 breast tissue samples is obtained. Based on these results, the proposed algorithm outperforms other state of the art methods evaluated under the same conditions for breast cancer classification based on DNA methylation data.


Towards Autonomous Satellite Communications An AI based Framework to Address System level Challenges. The next generation of satellite constellations is designed to better address the future needs of our connected society highly variable data demand, mobile connectivity, and reaching more under served regions. Artificial Intelligence (AI) and learning based methods are expected to become key players in the industry, given the poor scalability and slow reaction time of current resource allocation mechanisms. While AI frameworks have been validated for isolated communication tasks or subproblems, there is still not a clear path to achieve fully autonomous satellite systems. Part of this issue results from the focus on subproblems when designing models, instead of the necessary system level perspective. In this paper we try to bridge this gap by characterizing the system level needs that must be met to increase satellite autonomy, and introduce three AI based components (Demand Estimator, Offline Planner, and Real Time Engine) that jointly address them. We first do a broad literature review on the different subproblems and identify the missing links to the system level goals. In response to these gaps, we outline the three necessary components and highlight their interactions. We also discuss how current models can be incorporated into the framework and possible directions of future work.


Fixed Price Approximations in Bilateral Trade. We consider the bilateral trade problem, in which two agents trade a single indivisible item. It is known that the only dominant strategy truthful mechanism is the fixed price mechanism given commonly known distributions of the buyer's value B and the seller's value S , a price p is offered to both agents and trade occurs if S leq p leq B . The objective is to maximize either expected welfare mathbb E S (B S) mathbf 1 S leq p leq B or expected gains from trade mathbb E (B S) mathbf 1 S leq p leq B . We improve the approximation ratios for several welfare maximization variants of this problem. When the agents' distributions are identical, we show that the optimal approximation ratio for welfare is frac 2 sqrt 2 4 . With just one prior sample from the common distribution, we show that a 3 4 approximation to welfare is achievable. When agents' distributions are not required to be identical, we show that a previously best known (1 1 e) approximation can be strictly improved, but 1 1 e is optimal if only the seller's distribution is known.


Neural Auction End to End Learning of Auction Mechanisms for E Commerce Advertising. In e commerce advertising, it is crucial to jointly consider various performance metrics, e.g., user experience, advertiser utility, and platform revenue. Traditional auction mechanisms, such as GSP and VCG auctions, can be suboptimal due to their fixed allocation rules to optimize a single performance metric (e.g., revenue or social welfare). Recently, data driven auctions, learned directly from auction outcomes to optimize multiple performance metrics, have attracted increasing research interests. However, the procedure of auction mechanisms involves various discrete calculation operations, making it challenging to be compatible with continuous optimization pipelines in machine learning. In this paper, we design underline D eep underline N eural underline A uctions (DNAs) to enable end to end auction learning by proposing a differentiable model to relax the discrete sorting operation, a key component in auctions. We optimize the performance metrics by developing deep models to efficiently extract contexts from auctions, providing rich features for auction design. We further integrate the game theoretical conditions within the model design, to guarantee the stability of the auctions. DNAs have been successfully deployed in the e commerce advertising system at Taobao. Experimental evaluation results on both large scale data set as well as online A B test demonstrated that DNAs significantly outperformed other mechanisms widely adopted in industry.


On the Reverse Complement String Duplication System. Motivated by DNA storage in living organisms, and by known biological mutation processes, we study the reverse complement string duplication system. We fully classify the conditions under which the system has full expressiveness, for all alphabets and all fixed duplication lengths. We then focus on binary systems with duplication length 2 and prove that they have full capacity, yet surprisingly, have zero entropy rate. Finally, by using binary single burst insertion correcting codes, we construct codes that correct a single reverse complement duplication of odd length, over any alphabet. The redundancy (in bits) of the constructed code does not depend on the alphabet size.


A method using deep learning to discover new predictors of CRT response from mechanical dyssynchrony on gated SPECT MPI. Background. Studies have shown that the conventional left ventricular mechanical dyssynchrony (LVMD) parameters have their own statistical limitations. The purpose of this study is to extract new LVMD parameters from the phase analysis of gated SPECT MPI by deep learning to help CRT patient selection. Methods. One hundred and three patients who underwent rest gated SPECT MPI were enrolled in this study. CRT response was defined as a decrease in left ventricular end systolic volume (LVESV) 15 at 6 1 month follow up. Autoencoder (AE), an unsupervised deep learning method, was trained by the raw LV systolic phase polar maps to extract new LVMD parameters, called AE based LVMD parameters. Correlation analysis was used to explain the relationships between new parameters with conventional LVMD parameters. Univariate and multivariate analyses were used to establish a multivariate model for predicting CRT response. Results. Complete data were obtained in 102 patients, 44.1 of them were classified as CRT responders. AE based LVMD parameter was significant in the univariate (OR 1.24, 95 CI 1.07 1.44, P 0.006) and multivariate analyses (OR 1.03, 95 CI 1.01 1.06, P 0.006). Moreover, it had incremental value over PSD (AUC 0.72 vs. 0.63, LH 8.06, P 0.005) and PBW (AUC 0.72 vs. 0.64, LH 7.87, P 0.005), combined with significant clinic characteristics, including LVEF and gender. Conclusions. The new LVMD parameters extracted by autoencoder from the baseline gated SPECT MPI has the potential to improve the prediction of CRT response.


Bayesian Inference with Certifiable Adversarial Robustness. We consider adversarial training of deep neural networks through the lens of Bayesian learning, and present a principled framework for adversarial training of Bayesian Neural Networks (BNNs) with certifiable guarantees. We rely on techniques from constraint relaxation of non convex optimisation problems and modify the standard cross entropy error model to enforce posterior robustness to worst case perturbations in epsilon balls around input points. We illustrate how the resulting framework can be combined with methods commonly employed for approximate inference of BNNs. In an empirical investigation, we demonstrate that the presented approach enables training of certifiably robust models on MNIST, FashionMNIST and CIFAR 10 and can also be beneficial for uncertainty calibration. Our method is the first to directly train certifiable BNNs, thus facilitating their deployment in safety critical applications.


Adversarial Robustness of Deep Reinforcement Learning based Dynamic Recommender Systems. Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding space of those techniques makes adversarial attacks difficult to detect at an early stage. Recent advance in causality shows that counterfactual can also be considered one of ways to generate the adversarial samples drawn from different distribution as the training samples. We propose to explore adversarial examples and attack agnostic detection on reinforcement learning based interactive recommendation systems. We first craft different types of adversarial examples by adding perturbations to the input and intervening on the casual factors. Then, we augment recommendation systems by detecting potential attacks with a deep learning based classifier based on the crafted data. Finally, we study the attack strength and frequency of adversarial examples and evaluate our model on standard datasets with multiple crafting methods. Our extensive experiments show that most adversarial attacks are effective, and both attack strength and attack frequency impact the attack performance. The strategically timed attack achieves comparative attack performance with only 1 3 to 1 2 attack frequency. Besides, our black box detector trained with one crafting method has the generalization ability over several other crafting methods.


Towards More Robust Natural Language Understanding. Natural Language Understanding (NLU) is a branch of Natural Language Processing (NLP) that uses intelligent computer software to understand texts that encode human knowledge. Recent years have witnessed notable progress across various NLU tasks with deep learning techniques, especially with pretrained language models. Besides proposing more advanced model architectures, constructing more reliable and trustworthy datasets also plays a huge role in improving NLU systems, without which it would be impossible to train a decent NLU model. It's worth noting that the human ability of understanding natural language is flexible and robust. On the contrary, most of existing NLU systems fail to achieve desirable performance on out of domain data or struggle on handling challenging items (e.g., inherently ambiguous items, adversarial items) in the real world. Therefore, in order to have NLU models understand human language more effectively, it is expected to prioritize the study on robust natural language understanding. In this thesis, we deem that NLU systems are consisting of two components NLU models and NLU datasets. As such, we argue that, to achieve robust NLU, the model architecture training and the dataset are equally important. Specifically, we will focus on three NLU tasks to illustrate the robustness problem in different NLU tasks and our contributions (i.e., novel models and new datasets) to help achieve more robust natural language understanding. Moving forward, the ultimate goal for robust natural language understanding is to build NLU models which can behave humanly. That is, it's expected that robust NLU systems are capable to transfer the knowledge from training corpus to unseen documents more reliably and survive when encountering challenging items even if the system doesn't know a priori of users' inputs.


Demonstrating REACT a Real time Educational AI powered Classroom Tool. We present a demonstration of REACT, a new Real time Educational AI powered Classroom Tool that employs EDM techniques for supporting the decision making process of educators. REACT is a data driven tool with a user friendly graphical interface. It analyzes students' performance data and provides context based alerts as well as recommendations to educators for course planning. Furthermore, it incorporates model agnostic explanations for bringing explainability and interpretability in the process of decision making. This paper demonstrates a use case scenario of our proposed tool using a real world dataset and presents the design of its architecture and user interface. This demonstration focuses on the agglomerative clustering of students based on their performance (i.e., incorrect responses and hints used) during an in class activity. This formation of clusters of students with similar strengths and weaknesses may help educators to improve their course planning by identifying at risk students, forming study groups, or encouraging tutoring between students of different strengths.


Lebesgue integration. Detailed proofs to be formalized in Coq. To obtain the highest confidence on the correction of numerical simulation programs implementing the finite element method, one has to formalize the mathematical notions and results that allow to establish the soundness of the method. Sobolev spaces are the mathematical framework in which most weak formulations of partial derivative equations are stated, and where solutions are sought. These functional spaces are built on integration and measure theory. Hence, this chapter in functional analysis is a mandatory theoretical cornerstone for the definition of the finite element method. The purpose of this document is to provide the formal proof community with very detailed pen and paper proofs of the main results from integration and measure theory.


On Supercompactly and Compactly Generated Toposes. We present and characterize the classes of Grothendieck toposes having enough supercompact objects or enough compact objects. In the process, we examine the subcategories of supercompact objects and compact objects within such toposes and classes of geometric morphism which interact well with these objects. We also present canonical classes of sites generating such toposes.


Learning Diagonal Gaussian Mixture Models and Incomplete Tensor Decompositions. This paper studies how to learn parameters in diagonal Gaussian mixture models. The problem can be formulated as computing incomplete symmetric tensor decompositions. We use generating polynomials to compute incomplete symmetric tensor decompositions and approximations. Then the tensor approximation method is used to learn diagonal Gaussian mixture models. We also do the stability analysis. When the first and third order moments are sufficiently accurate, we show that the obtained parameters for the Gaussian mixture models are also highly accurate. Numerical experiments are also provided.


Headed Span Based Projective Dependency Parsing. We propose a new method for projective dependency parsing based on headed spans. In a projective dependency tree, the largest subtree rooted at each word covers a contiguous sequence (i.e., a span) in the surface order. We call such a span marked by a root word textit headed span . A projective dependency tree can be represented as a collection of headed spans. We decompose the score of a dependency tree into the scores of the headed spans and design a novel O(n 3) dynamic programming algorithm to enable global training and exact inference. Our model achieves state of the art or competitive results on PTB, CTB, and UD. Our code is publicly available at url https github.com sustcsonglin span based dependency parsing .


Free lattice functors weakly preserve epi pullbacks. Suppose p(x,y,z) and q(x,y,z) are terms. If there is a common "ancestor" term s(z 1 ,z 2 ,z 3 ,z 4 ) specializing to p and q through identifying some variables begin align p(x,y,z) approx s(x,y,z,z) q(x,y,z) approx s(x,x,y,z), end align then the equation p(x,x,z) approx q(x,z,z) is trivially obtained by syntactic unification of s(x,y,z,z) with s(x,x,y,z). In this note we show that for lattice terms, and more generally for terms of lattice ordered algebras, the converse is true, too. Given terms p,q, and an equation begin equation p(u 1 , ldots,u m ) approx q(v 1 , ldots,v n ) label eq p eq q end equation where u 1 , ldots,u m v 1 , ldots,v n , there is always an "ancestor term" s(z 1 , ldots,z r ) such that p(x 1 , ldots,x m ) and q(y 1 , ldots,y n ) arise as substitution instances of s, whose unification results in the original equation. In category theoretic terms the above proposition, when restricted to lattices, has a much more concise formulation Free lattice functors weakly preserves pullbacks of epis.


What's Hidden in a One layer Randomly Weighted Transformer?. We demonstrate that, hidden within one layer randomly weighted neural networks, there exist subnetworks that can achieve impressive performance, without ever modifying the weight initializations, on machine translation tasks. To find subnetworks for one layer randomly weighted neural networks, we apply different binary masks to the same weight matrix to generate different layers. Hidden within a one layer randomly weighted Transformer, we find that subnetworks that can achieve 29.45 17.29 BLEU on IWSLT14 WMT14. Using a fixed pre trained embedding layer, the previously found subnetworks are smaller than, but can match 98 92 (34.14 25.24 BLEU) of the performance of, a trained Transformer small base on IWSLT14 WMT14. Furthermore, we demonstrate the effectiveness of larger and deeper transformers in this setting, as well as the impact of different initialization methods. We released the source code at https github.com sIncerass one layer lottery ticket.


Visualizing coherent molecular rotation in a gaseous medium. Inducing and controlling the ultrafast molecular rotational dynamics using shaped laser fields is essential in numerous applications. Several approaches exist that allow following the coherent molecular motion in real time, including Coulomb explosion based techniques and recovering molecular orientation from the angular distribution of high harmonics. We theoretically consider a non intrusive optical scheme for visualizing the rotational dynamics in an anisotropic molecular gas. The proposed method allows determining the instantaneous orientation of the principal optical axes of the gas. The method is based on probing the sample using ultra short circularly polarized laser pulses and recording the transmission image through a vortex wave plate. We consider two example excitations molecular alignment induced by an intense linearly polarized laser pulse and unidirectional molecular rotation induced by a polarization shaped pulse. The proposed optical method is promising for visualizing the dynamics of complex symmetric and asymmetric top molecules.


Dopamine Differentially Private Federated Learning on Medical Data. While rich medical datasets are hosted in hospitals distributed across the world, concerns on patients' privacy is a barrier against using such data to train deep neural networks (DNNs) for medical diagnostics. We propose Dopamine, a system to train DNNs on distributed datasets, which employs federated learning (FL) with differentially private stochastic gradient descent (DPSGD), and, in combination with secure aggregation, can establish a better trade off between differential privacy (DP) guarantee and DNN's accuracy than other approaches. Results on a diabetic retinopathy (DR) task show that Dopamine provides a DP guarantee close to the centralized training counterpart, while achieving a better classification accuracy than FL with parallel DP where DPSGD is applied without coordination. Code is available at https github.com ipc lab private ml for health.


NeuralDP Differentially private neural networks by design. The application of differential privacy to the training of deep neural networks holds the promise of allowing large scale (decentralized) use of sensitive data while providing rigorous privacy guarantees to the individual. The predominant approach to differentially private training of neural networks is DP SGD, which relies on norm based gradient clipping as a method for bounding sensitivity, followed by the addition of appropriately calibrated Gaussian noise. In this work we propose NeuralDP, a technique for privatising activations of some layer within a neural network, which by the post processing properties of differential privacy yields a differentially private network. We experimentally demonstrate on two datasets (MNIST and Pediatric Pneumonia Dataset (PPD)) that our method offers substantially improved privacy utility trade offs compared to DP SGD.


cCorrGAN Conditional Correlation GAN for Learning Empirical Conditional Distributions in the Elliptope. We propose a methodology to approximate conditional distributions in the elliptope of correlation matrices based on conditional generative adversarial networks. We illustrate the methodology with an application from quantitative finance Monte Carlo simulations of correlated returns to compare risk based portfolio construction methods. Finally, we discuss about current limitations and advocate for further exploration of the elliptope geometry to improve results.


Enantioselection and chiral sorting of single microspheres using optical pulling forces. We put forward a novel, twofold scheme that enables at the same time all optical enantioselection and sorting of single multipolar chiral microspheres based on optical pulling forces exerted by two non collinear, nonstructured, circularly polarized light sources. Our chiral resolution method can be externally controlled by varying the angle between their incident wavevectors, allowing for a fine tuning of the range of chiral indices for enantioselection. Enantioselectivity is achieved by choosing angles such that only particles with the same handedness of the light sources are pulled. This proposal allows one to achieve all optical sorting of chiral microspheres with arbitrarily small chiral parameters, thus outperforming current optical methods.


A Step Towards On Path Security Function Outsourcing. Security function outsourcing has witnessed both research and deployment in the recent years. While most existing services take a straight forward approach of cloud hosting, on path transit networks (such as ISPs) are increasingly more interested in offering outsourced security services to end users. Recent proposals (such as SafeBricks and mbTLS) have made it possible to outsource sensitive security applications to untrusted, arbitrary networks, rendering on path security function outsourcing more promising than ever. However, to provide on path security function outsourcing, there is one crucial component that is still missing a practical end to end network protocol. Thus, the discovery and orchestration of multiple capable and willing transit networks for user requested security functions have only been assumed in many studies without any practical solutions. In this work, we propose Opsec, an end to end security outsourcing protocol that fills this gap and brings us closer to the vision of on path security function outsourcing. Opsec automatically discovers one or more transit ISPs between a client and a server, and requests user specified security functions efficiently. When designing Opsec, we prioritize the practicality and applicability of this new end to end protocol in the current Internet. Our proof of concept implementation of Opsec for web sessions shows that an end user can easily start a new web session with a few clicks of a browser plug in, to specify a series of security functions of her choice. We show that it is possible to implement such a new end to end service model in the current Internet for the majority of the web services without any major changes to the standard protocols (e.g., TCP, TLS, HTTP) and the existing network infrastructure (e.g., ISP's routing primitives).


The Eremenko Lyubich constant. Eremenko and Lyubich proved that an entire function whose set of singular values is bounded is expanding at points where its image has large modulus. These expansion properties have been at the centre of the subsequent study of this class of functions, now called the Eremenko Lyubich class. We improve the estimate of Eremenko and Lyubich, and show that the new estimate is asymptotically optimal. As a corollary, we obtain an elementary proof that functions in the Eremenko Lyubich class have lower order at least 1 2 .